One-liners - Revision history

Unhammer: /* Useful (mostly) bash one-liners */

2010-06-27T06:24:39Z

Useful (mostly) bash one-liners

2010-06-21T15:15:07Z

2010-06-13T19:50:02Z

2010-06-13T15:34:38Z

2010-06-13T15:34:04Z

@@ Line 25: / Line 25: @@
 </pre>
+Alternatively: <code>tr '\n' ' '</code>
 [[Category:Tools]]

@@ Line 1: / Line 1: @@
-{{TOCD}}
 ==Useful (mostly) bash one-liners==
@@ Line 15: / Line 13: @@
 <pre>
 sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' |  sort -f | uniq -ci  | sort -gr
+</pre>
+<pre>
+tr " " "\n" | grep "@" | tr -d "[:punct:]" | sort | uniq -c | sort -r
 </pre>

@@ Line 3: / Line 3: @@
 ==Useful (mostly) bash one-liners==
-* Perl regular-expression for removing all tags after the initial:  perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;'
+* Perl regular-expression for removing all tags after the initial:
+<pre>
+perl -pe 's/(\^[^<]+<[^>]+>)(<\w+>)*\$/\1\$/g;'
 ^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$
+</pre>
+* Get unknown words from chunked text and sort by frequency:
+<pre>
+sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' |  sort -f | uniq -ci  | sort -gr
+</pre>
+* Strip newlines:
+<pre>
-* Get unknown words from chunked text and sort by frequency: sed 's/\$\W*\^/$\n^/g' | grep '@' | sed 's/><.*/>$/g' |  sort -f | uniq -ci  | sort -gr
+sed ':a;N;$!ba;s/\n//g'
+</pre>
+[[Category:Tools]]
-* Strip newlines: sed ':a;N;$!ba;s/\n//g'

← Older revision		Revision as of 15:34, 13 June 2010
Line 8:		Line 8:

	* Get unknown words from chunked text and sort by frequency: sed 's/\$\W\^/$\n^/g' \| grep '@' \| sed 's/><./>$/g' \| sort -f \| uniq -ci \| sort -gr		* Get unknown words from chunked text and sort by frequency: sed 's/\$\W\^/$\n^/g' \| grep '@' \| sed 's/><./>$/g' \| sort -f \| uniq -ci \| sort -gr

			* Strip newlines: sed ':a;N;$!ba;s/\n//g'

← Older revision		Revision as of 15:34, 13 June 2010
Line 6:		Line 6:

	^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$		^Lemma<V><Pres><Sg>$ -> ^Lemma<V>$

			* Get unknown words from chunked text and sort by frequency: sed 's/\$\W\^/$\n^/g' \| grep '@' \| sed 's/><./>$/g' \| sort -f \| uniq -ci \| sort -gr