Difference between revisions of "One-liners"
Jump to navigation
Jump to search
(Created page with '{{TOCD}} ==Useful (mostly) bash one-liners== * Perl regular-expression for removing all tags after the initial: perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;' ^Lemma<V><Pres…') |
|||
| (4 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
{{TOCD}} |
|||
==Useful (mostly) bash one-liners== |
==Useful (mostly) bash one-liners== |
||
* Perl regular-expression for removing all tags after the initial: |
* Perl regular-expression for removing all tags after the initial: |
||
<pre> |
|||
perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;' |
|||
^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$ |
^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$ |
||
</pre> |
|||
* Get unknown words from chunked text and sort by frequency: |
|||
<pre> |
|||
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' | sort -f | uniq -ci | sort -gr |
|||
</pre> |
|||
<pre> |
|||
tr " " "\n" | grep "@" | tr -d "[:punct:]" | sort | uniq -c | sort -r |
|||
</pre> |
|||
* Strip newlines: |
|||
<pre> |
|||
sed ':a;N;$!ba;s/\n//g' |
|||
</pre> |
|||
Alternatively: <code>tr '\n' ' '</code> |
|||
[[Category:Tools]] |
|||
Latest revision as of 06:24, 27 June 2010
Useful (mostly) bash one-liners[edit]
- Perl regular-expression for removing all tags after the initial:
perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;' ^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$
- Get unknown words from chunked text and sort by frequency:
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' | sort -f | uniq -ci | sort -gr
tr " " "\n" | grep "@" | tr -d "[:punct:]" | sort | uniq -c | sort -r
- Strip newlines:
sed ':a;N;$!ba;s/\n//g'
Alternatively: tr '\n' ' '
