Apertium Turkic/Use/MT - Revision history

Unhammer at 12:35, 16 January 2014

2014-01-16T12:35:33Z

Unhammer at 12:34, 16 January 2014

2014-01-16T12:34:36Z

Francis Tyers at 12:09, 16 January 2014

2014-01-16T12:09:27Z

Francis Tyers at 12:08, 16 January 2014

2014-01-16T12:08:41Z

Unhammer at 12:00, 16 January 2014

2014-01-16T12:00:58Z

Unhammer at 11:58, 16 January 2014

2014-01-16T11:58:06Z

Unhammer at 10:41, 16 January 2014

2014-01-16T10:41:06Z

Unhammer: Created page with "The dictionary languages/apertium-kaz/apertium-kaz.kaz.lexc has a bunch of lines with the comment `! Use/MT eng-kaz`. These lines are only to appear in machine translat..."

2014-01-16T10:38:36Z

Created page with "The dictionary languages/apertium-kaz/apertium-kaz.kaz.lexc has a bunch of lines with the comment <tt>! Use/MT eng-kaz</tt>. These lines are only to appear in machine translat..."

New page

The dictionary languages/apertium-kaz/apertium-kaz.kaz.lexc has a bunch of lines with the comment <tt>! Use/MT eng-kaz</tt>. These lines are only to appear in machine translation pairs, not when creating a "vanilla" transducer. It's easy to grep them out, but harder to get this into the current build system where language pairs depend on the pre-built att.gz of languages/apertium-kaz and trim that.

Some options:

#. Make two binaries in languages/apertium-kaz, one vanilla and one MT.
#* Cons: takes a lot longer to make apertium-kaz, installed size doubles, looks messy

#. Use/MT as a compiler-tag, removed by twol in langs

#. Redundant make steps in pairs

#. Use/MT as visible tag, removed by CG or similar

#. Create a transducer with only the grep lines. Subtract that from vanilla after creating the att.gz

#. Two transducers in langs, but run one to att.gz, vanilla to full binary.

@@ Line 30: / Line 30: @@
 #* Cons: Means that if you want both you need two checkouts, or keep switching back-and-forth.
 #*       Easy to forget which version you have, and not know why your MT pair suddenly doesn't work like it should
+#**          That can be counteracted a bit by having the make goals give them different names

@@ Line 29: / Line 29: @@
 # Use a <code>./configure</code> option (e.g. <code>--with-variant=mt</code>, <code>--with-variant=vanilla</code>) to switch a particular checkout of <code>apertium-kaz</code> to do one or the other (basically just ifdef some greps in the makefile).
 #* Cons: Means that if you want both you need two checkouts, or keep switching back-and-forth.
+#*       Easy to forget which version you have, and not know why your MT pair suddenly doesn't work like it should

@@ Line 28: / Line 28: @@
 #*       Ugly
 # Use a <code>./configure</code> option (e.g. <code>--with-variant=mt</code>, <code>--with-variant=vanilla</code>) to switch a particular checkout of <code>apertium-kaz</code> to do one or the other (basically just ifdef some greps in the makefile).
-#* Cons: Means that if you want both you need two checkouts
+#* Cons: Means that if you want both you need two checkouts, or keep switching back-and-forth.

@@ Line 27: / Line 27: @@
 #*       We still end up with two binary transducers in /languages/
 #*       Ugly
+# Use a <code>./configure</code> option (e.g. <code>--with-variant=mt</code>, <code>--with-variant=vanilla</code>) to switch a particular checkout of <code>apertium-kaz</code> to do one or the other (basically just ifdef some greps in the makefile).
+#* Cons: Means that if you want both you need two checkouts

@@ Line 3: / Line 3: @@
 Some options:
-#. Make two binaries in languages/apertium-kaz, one vanilla and one MT.
+# Make two binaries in languages/apertium-kaz, one vanilla and one MT.
-#* Cons: takes a lot longer to make apertium-kaz; installed size of languages module doubles; messy
+#* Cons: Takes a lot longer to make apertium-kaz
+#*       Installed size of languages module doubles
+#*       Messy
-#. Make two transducers in /languages/ (vanilla + MT), but run the MT only to att.gz, while the vanilla is run to full binary.
+# Make two transducers in /languages/ (vanilla + MT), but run the MT only to att.gz, while the vanilla is run to full binary.
-#* Cons: takes longer to make apertium-kaz; installed size of languages module increases; still a bit messy
+#* Cons: Takes longer to make apertium-kaz
+#*       Installed size of languages module increases
-#. Have Use/MT as a visible tag, with paths (vanilla) or tags (MT) removed by postprocessing scripts (or CG)
+#*       Still a bit messy
-#* Cons: Ugggly. Ugly. Ugly.
+# Have Use/MT as a visible tag, with paths (vanilla) or tags (MT) removed by postprocessing scripts (or CG)
+#* Cons: Ugggly
-#. Have Use/MT as a compiler-tag, paths with this tag are removed by twol when compiling for vanilla, while the tag itself is removed by twol when compiling for MT
+#*       Ugly
+#*       Ugly
+# Have Use/MT as a compiler-tag, paths with this tag are removed by twol when compiling for vanilla, while the tag itself is removed by twol when compiling for MT
 #* Cons: compilation-internal tags, that's almost as bad as flag diacritics.
+# Redundant make steps in pairs: the pair references $(AP_SRC1)/apertium-kaz.lexc and does all the same steps up to att.gz which are specified in the /languages/apertium-kaz/Makefile (except in /languages/, there's a "grep -v Use/MT" line in the lexc-step)
+#* Cons: Lots of redundant make code
-#. Redundant make steps in pairs: the pair references $(AP_SRC1)/apertium-kaz.lexc and does all the same steps up to att.gz which are specified in the /languages/apertium-kaz/Makefile (except in /languages/, there's a "grep -v Use/MT" line in the lexc-step)
-#* Cons: Lots of redundant make code, an update one place leads to a lot of Makefiles having to be updated; takes a lot longer to make each language pair; messy
+#*       An update one place leads to a lot of Makefiles having to be updated
+#*       It takes a lot longer to make each language pair
+#*       Messy
-#. Create a binary transducer with only the "grep Use/MT" lines. Use "hfst-subtract MT.bin Use/MT-only.bin" to subtract only the Use/MT lines from the MT transducer to create the vanilla transducer in /languages/
-#* Cons: We can't simply "grep Use/MT *lexc", since we also need the LEXICON lines and dog knows what else, would lead to really ugly lexicon-specific rules. And still we end up with two binary transducers in /languages/. Ugly.
+# Create a binary transducer with only the "grep Use/MT" lines. Use "hfst-subtract MT.bin Use/MT-only.bin" to subtract only the Use/MT lines from the MT transducer to create the vanilla transducer in /languages/
+#* Cons: We can't simply "grep Use/MT *lexc", since we also need the LEXICON lines and dog knows what else
+#*       It would lead to really ugly lexicon-specific rules
+#*       We still end up with two binary transducers in /languages/
+#*       Ugly

@@ Line 6: / Line 6: @@
 #* Cons: takes a lot longer to make apertium-kaz, installed size doubles, looks messy
-#. Use/MT as a compiler-tag, removed by twol in langs
+#. Have Use/MT as a visible tag, removed by CG or similar
+#* Cons: Ugggly
+#. Have Use/MT as a compiler-tag, paths with this tag are removed by twol when compiling for vanilla, while the tag itself is removed when compiling for MT
-#. Redundant make steps in pairs
+#. Redundant make steps in pairs
-#. Use/MT as visible tag, removed by CG or similar
 #. Create a transducer with only the grep lines. Subtract that from vanilla after creating the att.gz