One-liners

From Apertium
Revision as of 19:50, 13 June 2010 by Francis Tyers (talk | contribs)
Jump to navigation Jump to search

Useful (mostly) bash one-liners

  • Perl regular-expression for removing all tags after the initial:
perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;'

^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$
  • Get unknown words from chunked text and sort by frequency:
sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' |  sort -f | uniq -ci  | sort -gr
  • Strip newlines:
sed ':a;N;$!ba;s/\n//g'
Retrieved from "https://wiki.apertium.org/w/index.php?title=One-liners&oldid=19890"