Difference between revisions of "One-liners"

From Apertium
Jump to navigation Jump to search
 
(One intermediate revision by one other user not shown)
Line 1: Line 1:
{{TOCD}}

==Useful (mostly) bash one-liners==
==Useful (mostly) bash one-liners==


Line 15: Line 13:
<pre>
<pre>
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' | sort -f | uniq -ci | sort -gr
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' | sort -f | uniq -ci | sort -gr
</pre>

<pre>
tr " " "\n" | grep "@" | tr -d "[:punct:]" | sort | uniq -c | sort -r
</pre>
</pre>


Line 23: Line 25:
</pre>
</pre>


Alternatively: <code>tr '\n' ' '</code>
[[Category:Tools]]
[[Category:Tools]]

Latest revision as of 06:24, 27 June 2010

Useful (mostly) bash one-liners[edit]

  • Perl regular-expression for removing all tags after the initial:
perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;'

^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$
  • Get unknown words from chunked text and sort by frequency:
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' |  sort -f | uniq -ci  | sort -gr
tr " " "\n" | grep "@" | tr -d "[:punct:]" | sort | uniq -c | sort -r
  • Strip newlines:
sed ':a;N;$!ba;s/\n//g'

Alternatively: tr '\n' ' '