Compiling dictionaries - Revision history

Unhammer: /* Compilation options and attributes */

2021-03-19T20:36:44Z

Compilation options and attributes

Bech: Link to French page

2014-10-08T06:55:52Z

Link to French page

Unhammer: /* Slightly less standard lttoolbox dix compilation */

2014-03-10T14:19:50Z

Slightly less standard lttoolbox dix compilation

Unhammer: /* Standard lttoolbox dix compilation */

2014-03-10T14:15:49Z

Standard lttoolbox dix compilation

Unhammer: /* Standard lttoolbox dix compilation */

2013-12-08T08:19:45Z

Standard lttoolbox dix compilation

Unhammer: /* Standard lttoolbox dix compilation */

2013-12-08T08:14:18Z

Standard lttoolbox dix compilation

Unhammer: /* HFST lexc/twol */

2013-12-08T08:13:23Z

HFST lexc/twol

Unhammer: /* HFST lexc/twol */

2013-12-08T08:13:11Z

HFST lexc/twol

Unhammer at 08:12, 8 December 2013

2013-12-08T08:12:54Z

Bech: Category:Documentation in English

2011-09-03T18:26:51Z

Category:Documentation in English

@@ Line 30: / Line 30: @@
   -r:     set right language variant (bidix)
 </pre>
-The "alt" attribute is often used to specify that a given entry is only used in one language variant (like British vs US English spelling).
+The "alt" attribute is used to specify that a given entry is only used in one language variant (like British vs US English spelling).
+The "vr" attribute is used in bidix to say that the <code>&lt;r&gt;</code> entry is only relevant for that variant, when translating left-to-right (it is included when going the other direction).
-* TODO: what is v/vl/vr?
+The "vl" attribute is used in bidix to say that the <code>&lt;l&gt;</code> entry is only relevant for that variant, when translating right-to-left (it is included when going the other direction).
+* TODO: what is "v"?
 ==ATT compilation==

@@ Line 1: / Line 1: @@
+[[Compilation des dictionnaires|En français]]
 {{TOCD}}
 This page gives some specific instructions for compiling dictionaries from various language pairs using different build procedures, this page is principally for people who are interested in using the dictionaries as analysers or generators, and not as part of a language pair.

@@ Line 20: / Line 20: @@
 </pre>
+==Compilation options and attributes==
-==Slightly less standard lttoolbox dix compilation==
-<code>lt-comp</code> can also compile [[ATT format]] files; this includes the output of [[HFST|hfst-fst2txt]]:
+Apart from the direction (lr vs rl), <code>lt-comp</code> also has some options to use values of the "alt", "v", "vl" or "vr" dix attributes in compilation:
-<pre>
-$ hfst-fst2txt bak.automorf.hfst > bak.att
-$ lt-comp lr bak.att bak.automorf.bin
-main@standard 8435 14708
-final@inconditional 14 34
-</pre>
-Note that the final@inconditional section is "guessed" (anything starting with punctuation goes into that section).
-<code>lt-comp</code> also has some options to use values of the "alt", "v", "vl" or "vr" dix attributes in compilation:
 <pre>
   -v:     set language variant
@@ Line 40: / Line 31: @@
 * TODO: what is v/vl/vr?
+==ATT compilation==
+<code>lt-comp</code> can also compile [[ATT format]] files; this includes the output of [[HFST|hfst-fst2txt]]:
+<pre>
+$ hfst-fst2txt bak.automorf.hfst > bak.att
+$ lt-comp lr bak.att bak.automorf.bin
+main@standard 8435 14708
+final@inconditional 14 34
+</pre>
+Note that the final@inconditional section is "guessed" (anything starting with punctuation goes into that section).
 ==Metadix compilation==

@@ Line 19: / Line 19: @@
 main@standard 10245 22228
 </pre>
+==Slightly less standard lttoolbox dix compilation==
+<code>lt-comp</code> can also compile [[ATT format]] files; this includes the output of [[HFST|hfst-fst2txt]]:
+<pre>
+$ hfst-fst2txt bak.automorf.hfst > bak.att
+$ lt-comp lr bak.att bak.automorf.bin
+main@standard 8435 14708
+final@inconditional 14 34
+</pre>
+Note that the final@inconditional section is "guessed" (anything starting with punctuation goes into that section).
+<code>lt-comp</code> also has some options to use values of the "alt", "v", "vl" or "vr" dix attributes in compilation:
+<pre>
+  -v:     set language variant
+  -a:     set alternative (monodix)
+  -l:     set left language variant (bidix)
+  -r:     set right language variant (bidix)
+</pre>
+The "alt" attribute is often used to specify that a given entry is only used in one language variant (like British vs US English spelling).
+* TODO: what is v/vl/vr?
 ==Metadix compilation==

@@ Line 3: / Line 3: @@
 ==Standard lttoolbox dix compilation==
-Assuming you want to compile an lttoolbox XML dictionary file <code>apertium-bn-en.bn.dix</code> and save it as <code>bn.analyser.bin</code>:
+Assuming you want to compile an lttoolbox XML dictionary file <code>apertium-bn-en.bn.dix</code> into an analyser and save it as <code>bn.analyser.bin</code>:
 <pre>
 $ lt-comp lr apertium-bn-en.bn.dix bn.analyser.bin
@@ Line 11: / Line 11: @@
 See [[lttoolbox]] or [[Using an lttoolbox dictionary]] on how to analyse using this dictionary.
+The "lr" argument means "compile from left to right"; for monolingual dictionaries, this produces an analyser. If you gave "rl" instead, it would produce a generator:
+<pre>
+$ lt-comp rl apertium-bn-en.bn.dix bn.generator.bin
+final@inconditional 8 76
+main@standard 10245 22228
+</pre>
 ==Metadix compilation==

@@ Line 53: / Line 53: @@
 ==HFST lexc/twol ==
-''''[[HFST]]'''-based analysers/generators, like metadix, often have compilation procedures that differ from module to module. In general, it is easier to compile a language module or language pair using the regular procedure for that module (see [[Installation]]).
+'''[[HFST]]'''-based analysers/generators, like metadix, often have compilation procedures that differ from module to module. In general, it is easier to compile a language module or language pair using the regular procedure for that module (see [[Installation]]).
 ==See also==

@@ Line 1: / Line 1: @@
 {{TOCD}}
 This page gives some specific instructions for compiling dictionaries from various language pairs using different build procedures, this page is principally for people who are interested in using the dictionaries as analysers or generators, and not as part of a language pair.
-===Standard dix compilation===
+==Standard lttoolbox dix compilation==
-Assuming you want to compile the file <code>apertium-bn-en.bn.dix</code> and save it as <code>bn.analyser.bin</code>:
+Assuming you want to compile an lttoolbox XML dictionary file <code>apertium-bn-en.bn.dix</code> and save it as <code>bn.analyser.bin</code>:
 <pre>
 $ lt-comp lr apertium-bn-en.bn.dix bn.analyser.bin
@@ Line 9: / Line 10: @@
 </pre>
+See [[lttoolbox]] on how to analyse using this dictionary.
-==English&mdash;Catalan==
+==Metadix compilation==
+Some languages use non-standard extensions of the lttoolbox XML format. The term '''[[metadix]]''' covers any such extended dictionary. These are typically processed with xsltproc, and then the processed output of xsltproc is compiled like standard dix files. Since each analyser might use different xslt scripts, there is no one single procedure to compile all such metadix dictionaries.
+In general, it is easier to compile a language module or language pair using the regular procedure for that module (see [[Installation]]), but we give some examples here for how to perform only the essential commands to compile certain metadix analysers:
+===English&mdash;Catalan===
 The English dictionary in English&mdash;Catalan, along with the English dictionaries in some other pairs (e.g. English&mdash;Spanish and English&mdash;Galician) uses a [[metadix]] file. This needs to be preprocessed before it can be compiled with <code>lt-comp</code>.
@@ Line 25: / Line 33: @@
 </pre>
-==Breton&mdash;French==
+===Breton&mdash;French===
 The French dictionary in Breton&mdash;French is a [[metadix]] file which needs to be preprocessed before it can be compiled with <code>lt-comp</code>.
@@ Line 38: / Line 46: @@
 </pre>
-==Portuguese&mdash;Spanish==
+===Portuguese&mdash;Spanish===
+===Occitan&mdash;Catalan===
+===French&mdash;Spanish===
+==HFST lexc/twol ==
-==Occitan&mdash;Catalan==
+HFST-based analysers/generators, like metadix, often have compilation procedures that differ from module to module. In general, it is easier to compile a language module or language pair using the regular procedure for that module (see [[Installation]]).
+See also [[HFST]].
-==French&mdash;Spanish==
 ==See also==

@@ Line 52: / Line 52: @@
 [[Category:Lttoolbox|*]]
 [[Category:Morphological analysers]]
+[[Category:Documentation in English]]