Multitrans - Revision history

Naan Dhaan at 05:40, 22 August 2021

2021-08-22T05:40:06Z

Naan Dhaan: Adding description to -f

2021-08-22T05:25:03Z

Adding description to -f

Naan Dhaan at 10:21, 9 May 2021

2021-05-09T10:21:18Z

Naan Dhaan: /* -b */

2021-05-09T10:19:33Z

-b

Unhammer: /* -t */

2015-04-29T12:55:42Z

-t

Unhammer at 12:54, 29 April 2015

2015-04-29T12:54:44Z

Unhammer at 12:43, 29 April 2015

2015-04-29T12:43:36Z

Unhammer: Created page with "'''multitrans''' is a program found in apertium-lex-tools, used as a helper when training (see Learning rules from parallel and non-parallel corpora).

 multitrans sl..."

2015-04-29T12:43:16Z

Created page with "'''multitrans''' is a program found in apertium-lex-tools, used as a helper when training (see Learning rules from parallel and non-parallel corpora). <pre> multitrans sl..."

New page

'''multitrans''' is a program found in apertium-lex-tools, used as a helper when training (see [[Learning rules from parallel and non-parallel corpora]]).

<pre>
multitrans sl-tl.autobil.bin -b
</pre>
is equivalent to doing <code>lt-proc -b sl-tl.autobil.bin</code> if the input consists of just correctly formatted lexical units (lt-proc -b fails on some misformattings that multitrans ignores).

<pre>
multitrans sl-tl.autobil.bin -p -t
</pre>
will trim the tags to what the bidix has, so if bidix has an entry for kake<n><f>, you'll get
<pre>
$ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
^kake<n><f><*>$
</pre>

[[Category:Lexical selection]]

@@ Line 3: / Line 3: @@
 ==modes==
-===-b===
+===-b | --biltrans===
 This will output the source along with all target translations, like lt-proc -b.
@@ Line 12: / Line 12: @@
 is equivalent to doing <code>lt-proc -b sl-tl.autobil.bin</code> if the input consists of just correctly formatted lexical units (lt-proc -b fails on some misformattings that multitrans ignores).
-===-p===
+===-p | --tagger-output===
 This will output the source side only, so used alone it turns into cat, but used with -t you can trim the tags to what bidix has.
@@ Line 21: / Line 21: @@
 </pre>
-===-m===
+===-m | --multitrans===
 This will output one entry on each line with a pair of translations, e.g.
 <pre>
@@ Line 32: / Line 32: @@
 ==Options==
-===-t===
+===-t | --trim-lines===
 Trims off tags that don't appear in bidix, e.g. if bidix has an entry for kake&lt;n&gt;&lt;f&gt;:
 <pre>
@@ Line 54: / Line 54: @@
 Applies filters on the sentences. When applied, outputs only sentences having ambiguous words, <code>fertility < 10000</code>(number of combinations of sentences that can be formed using the ambiguous words) and <code>coverage >= 90</code>(some filter on the number of ambiguous words)
-===-n===
+===-n | --number-lines===
 Numbers the lines. Doesn't seem to make a difference under the -m mode.
+===-z | --null-flush===
+https://wiki.apertium.org/wiki/Null_flush
 [[Category:Lexical selection]]

@@ Line 51: / Line 51: @@
 </pre>
-===-f===
+===-f | --filter-lines===
+Applies filters on the sentences. When applied, outputs only sentences having ambiguous words, <code>fertility < 10000</code>(number of combinations of sentences that can be formed using the ambiguous words) and <code>coverage >= 90</code>(some filter on the number of ambiguous words)
-what does this do?
 ===-n===

@@ Line 17: / Line 17: @@
 So if bidix has an entry for kake&lt;n&gt;&lt;f&gt;, you'll get
 <pre>
-$ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
+$ echo '^kake<n><f><sg><def>$' |multitrans -p -t nno-nob.autobil.bin
 ^kake<n><f><*>$
 </pre>
@@ Line 24: / Line 24: @@
 This will output one entry on each line with a pair of translations, e.g.
 <pre>
-$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -m
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans -m nor-eng.autobil.bin
 .[][0 0].[]     ^obsternasig<adj><pst><sg><ind>/obstinate<adj><pst><sg><ind>$
 .[][0 1].[]     ^obsternasig<adj><pst><sg><ind>/obdurate<adj><pst><sg><ind>$
@@ Line 35: / Line 35: @@
 Trims off tags that don't appear in bidix, e.g. if bidix has an entry for kake&lt;n&gt;&lt;f&gt;:
 <pre>
-$ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
+$ echo '^kake<n><f><sg><def>$' |multitrans -p -t nno-nob.autobil.bin
 ^kake<n><f><*>$
 </pre>
@@ Line 41: / Line 41: @@
 Can be used with -m or -b as well:
 <pre>
-$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -m -t
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans -m -t nor-eng.autobil.bin
 .[][0 0].[]     ^obsternasig<adj><*>/obstinate<adj><*>$
 .[][0 1].[]     ^obsternasig<adj><*>/obdurate<adj><*>$
@@ Line 47: / Line 47: @@
 .[][0 3].[]     ^obsternasig<adj><*>/refractory<adj><*>$
-$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -b -t
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans -b -t nor-eng.autobil.bin
 ^obsternasig<adj><*>/obstinate<adj><*>/obdurate<adj><*>/stubborn<adj><*>/refractory<adj><*>$
 </pre>

@@ Line 37: / Line 37: @@
 $ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
 ^kake<n><f><*>$
+</pre>
+Can be used with -m or -b as well:
+<pre>
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -m -t
+.[][0 0].[]     ^obsternasig<adj><*>/obstinate<adj><*>$
+.[][0 1].[]     ^obsternasig<adj><*>/obdurate<adj><*>$
+.[][0 2].[]     ^obsternasig<adj><*>/stubborn<adj><*>$
+.[][0 3].[]     ^obsternasig<adj><*>/refractory<adj><*>$
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -b -t
+^obsternasig<adj><*>/obstinate<adj><*>/obdurate<adj><*>/stubborn<adj><*>/refractory<adj><*>$
 </pre>

@@ Line 1: / Line 1: @@
 '''multitrans''' is a program found in apertium-lex-tools, used as a helper when training (see [[Learning rules from parallel and non-parallel corpora]]).
-==-b==
+==modes==
+===-b===
+This will output the source along with all target translations, like lt-proc -b.
+Doing just
 <pre>
 multitrans sl-tl.autobil.bin -b
@@ Line 7: / Line 12: @@
 is equivalent to doing <code>lt-proc -b sl-tl.autobil.bin</code> if the input consists of just correctly formatted lexical units (lt-proc -b fails on some misformattings that multitrans ignores).
-==-p==
+===-p===
+This will output the source side only, so used alone it turns into cat, but used with -t you can trim the tags to what bidix has.
+So if bidix has an entry for kake&lt;n&gt;&lt;f&gt;, you'll get
 <pre>
-multitrans sl-tl.autobil.bin -p -t
+$ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
+^kake<n><f><*>$
 </pre>
-will trim the tags to what the bidix has, so if bidix has an entry for kake&lt;n&gt;&lt;f&gt;, you'll get
+===-m===
+This will output one entry on each line with a pair of translations, e.g.
+<pre>
+$ echo '^obsternasig<adj><pst><sg><ind>$' |multitrans nor-eng.autobil.bin -m
+.[][0 0].[]     ^obsternasig<adj><pst><sg><ind>/obstinate<adj><pst><sg><ind>$
+.[][0 1].[]     ^obsternasig<adj><pst><sg><ind>/obdurate<adj><pst><sg><ind>$
+.[][0 2].[]     ^obsternasig<adj><pst><sg><ind>/stubborn<adj><pst><sg><ind>$
+.[][0 3].[]     ^obsternasig<adj><pst><sg><ind>/refractory<adj><pst><sg><ind>$
+</pre>
+==Options==
+===-t===
+Trims off tags that don't appear in bidix, e.g. if bidix has an entry for kake&lt;n&gt;&lt;f&gt;:
 <pre>
 $ echo '^kake<n><f><sg><def>$' |multitrans nno-nob.autobil.bin -p -t
 ^kake<n><f><*>$
 </pre>
+===-f===
+what does this do?
+===-n===
+Numbers the lines. Doesn't seem to make a difference under the -m mode.