Starting a new language with HFST - Revision history

Francis Tyers: /* Analysis and generation */

2015-10-29T09:31:26Z

Analysis and generation

Francis Tyers: /* Enter twol */

2015-10-29T09:30:14Z

Enter twol

Francis Tyers: /* Lexicon */

2015-10-29T09:28:48Z

Lexicon

Firespeaker: /* Compiling */

2015-07-24T04:26:57Z

Compiling

Firespeaker: /* Preliminaries */

2015-07-24T04:15:43Z

Preliminaries

Unhammer: /* See also */

2014-12-30T08:12:04Z

Francis Tyers at 12:59, 25 April 2013

2013-04-25T12:59:18Z

AlexMetalhead: /* Analysis and generation */

2012-11-28T19:13:00Z

Analysis and generation

AlexMetalhead: /* With the power of intersecting composition! */

2012-11-28T19:12:15Z

With the power of intersecting composition!

AlexMetalhead: /* Continuation lexica */

2012-11-28T19:10:57Z

Continuation lexica

@@ Line 350: / Line 350: @@
 <pre>
-$ hfst-fst2fst -O -i tr-tk.autogen.hfst -o tr-tk.autogen.hfst.ol
+$ hfst-fst2fst -O -i tuk.autogen.hfst -o tuk.autogen.hfst.ol
 </pre>
@@ Line 356: / Line 356: @@
 <pre>
-$ echo "^maşgala<n><pl>$" | hfst-proc -g tr-tk.autogen.hfst.ol
+$ echo "^maşgala<n><pl>$" | hfst-proc -g tuk.autogen.hfst.ol
 maşgalalar
 </pre>
@@ Line 363: / Line 363: @@
 <pre>
-$ echo "^esger<n><pl>$" | hfst-proc -g tr-tk.autogen.hfst.ol
+$ echo "^esger<n><pl>$" | hfst-proc -g tuk.autogen.hfst.ol
 esgerler
 </pre>
@@ Line 370: / Line 370: @@
 <pre>
-$ hfst-invert -i tr-tk.autogen.hfst -o tk-tr.automorf.hfst
+$ hfst-invert -i tuk.autogen.hfst -o tuk.automorf.hfst
-$ hfst-fst2strings tk-tr.automorf.hfst
+$ hfst-fst2strings tuk.automorf.hfst
 maşgala:maşgala<n>
 maşgalalar:maşgala<n><pl>
@@ Line 382: / Line 382: @@
 <pre>
-$ hfst-fst2fst -O -i tk-tr.automorf.hfst -o tk-tr.automorf.hfst.ol
+$ hfst-fst2fst -O -i tuk.automorf.hfst -o tuk.automorf.hfst.ol
 </pre>
@@ Line 388: / Line 388: @@
 <pre>
-$ echo "maşgalalar" | hfst-proc tk-tr.automorf.hfst.ol
+$ echo "maşgalalar" | hfst-proc tuk.automorf.hfst.ol
 ^maşgalalar/maşgala<n><pl>$
-$ echo "esgerler" | hfst-proc tk-tr.automorf.hfst.ol
+$ echo "esgerler" | hfst-proc tuk.automorf.hfst.ol
 ^esgerler/esger<n><pl>$
 </pre>

@@ Line 254: / Line 254: @@
 What we basically want to say is "if the stem contains front vowels, then we want the front vowel alternation, if it contains back vowels then we want the back vowel alternation". And at the same time, remove the morpheme boundary. So let's give it a shot.
-We're going to make a new file <code>apertium-tr-tk.tk.twol</code>.
+We're going to make a new file <code>apertium-tuk.tuk.twol</code>.
 First we need to define the alphabet:
@@ Line 309: / Line 309: @@
 </pre>
-The rule is basically saying: "Substitute {A} with e if the previous letters are anything except back vowels, then there is a morpheme boundary, then there are no back vowels, and at some point there is a front vowel"
+The rule is basically saying: "A {A} is e if the previous letters are anything except back vowels, then there is a morpheme boundary, then there are no back vowels, and at some point there is a front vowel"
 Next up, to compile the rule and test it:
 <pre>
-$ hfst-twolc -R -i apertium-tr-tk.tk.twol -o tk-tr.twol.hfst
+$ hfst-twolc -R -i apertium-tuk.tuk.twol -o tuk.twol.hfst
-Reading input from tk.twol.
+Reading input from tuk.twol.
-Writing output to tk.twol.hfst.
+Writing output to tuk.twol.hfst.
 Reading alphabet.
 Reading sets.
@@ Line 330: / Line 330: @@
 <pre>
-$ hfst-compose-intersect -1 tk-tr.lexc.hfst -2 tk-tr.twol.hfst -o tr-tk.autogen.hfst
+$ hfst-compose-intersect -1 tuk.lexc.hfst -2 tuk.twol.hfst -o tuk.autogen.hfst
 </pre>
@@ Line 336: / Line 336: @@
 <pre>
-$ hfst-fst2strings tr-tk.autogen.hfst
+$ hfst-fst2strings tuk.autogen.hfst
 maşgala<n>:maşgala
 maşgala<n><pl>:maşgalalar

@@ Line 100: / Line 100: @@
 ==Lexicon==
-So, after going through the little description above, let's start with the lexicon. The file we're going to make is called <code>apertium-tr-tk.tk.lexc</code>, and it will contain the lexicon of the transducer. So open up your text editor.
+So, after going through the little description above, let's start with the lexicon. The file we're going to make is called <code>apertium-tuk.tuk.lexc</code>, and it will contain the lexicon of the transducer. So open up your text editor.
 ===The basics===
@@ Line 152: / Line 152: @@
 <pre>
-$ hfst-lexc apertium-tr-tk.tk.lexc -o tk-tr.lexc.hfst
+$ hfst-lexc apertium-tuk.tuk.lexc -o tuk.lexc.hfst
 </pre>
@@ Line 160: / Line 160: @@
 <pre>
-$ hfst-fst2strings tk-tr.lexc.hfst
+$ hfst-fst2strings tuk.lexc.hfst
 maşgala<n>:maşgala
 esger<n>:esger
@@ Line 233: / Line 233: @@
 <pre>
-$ hfst-lexc apertium-tr-tk.tk.lexc -o tk-tr.lexc.hfst
+$ hfst-lexc apertium-tuk.tuk.lexc -o tuk.lexc.hfst
 </pre>
@@ Line 239: / Line 239: @@
 <pre>
-$ hfst-fst2strings tk-tr.lexc.hfst
+$ hfst-fst2strings tuk.lexc.hfst
 maşgala<n><pl>:maşgala>l{A}r
 maşgala<n>:maşgala

@@ Line 155: / Line 155: @@
 </pre>
-(If you do not have <code>hfst-lexc</code> installed, you have a problem -- probably you need to compile with <code>--enable-lexc</code>, but in the meantime you can use <code>hfst-lexc2fst</code> in place of <code>hfst-lexc</code>)
+(If you do not have <code>hfst-lexc</code> installed, you have a problem -- probably you need to compile hfst with <code>--enable-lexc</code>, but in the meantime you can use <code>hfst-lexc2fst</code> in place of <code>hfst-lexc</code>.)
 And we can test it both with <code>hfst-fst2strings</code>:
@@ Line 164: / Line 164: @@
 esger<n>:esger
 </pre>
+If you bootstrapped a language pair with [[apertium-init]], then you can just run <code>make</code> to compile.
 ===Continuation lexica===

@@ Line 17: / Line 17: @@
 In the next sections we're going to start with the lexicon (<code>lexc</code> file) then progress onto the morphographemics (<code>twol</code> file).
-Make sure you have [[Hfst#Compiling_HFST3|HFST3]] compiled.
+Make sure you have [[Hfst#Compiling_HFST3|HFST3]] compiled.  You may also want to use [[apertium-init]] to start an minimal language module that will compile (<code>python3 apertium-init.py foo --analyser=hfst</code> where <code>foo</code> is the [[ISO 639-3]] code for the language).
 ==The language==

@@ Line 406: / Line 406: @@
 [[Category:HFST]]
+[[Category:Writing dictionaries]]
 [[Category:Quickstart]]

@@ Line 116: / Line 116: @@
 The symbols <code>&lt;</code> and <code>&gt;</code> are reserved in <code>lexc</code>, so we need to escape them with <code>%</code>
-We also need to define a <code>Root</code> lexicon, which is going to point to a list of stems in the lexicon <code>NounStems</code>. The <code>Root</code> lexicon is analagous to the <code><section id="main" type="standard"></code> in [[lttoolbox]]:
+We also need to define a <code>Root</code> lexicon, which is going to point to a list of stems in the lexicon <code>NounStems</code>. The <code>Root</code> lexicon is analagous to the <code>&lt;section id="main" type="standard"></code> in [[lttoolbox]]:
 <pre>

@@ Line 328: / Line 328: @@
 <pre>
-$ hfst-compose-intersect -1 tr-tk.lexc.hfst -2 tr-tk.twol.hfst -o tr-tk.autogen.hfst
+$ hfst-compose-intersect -1 tk-tr.lexc.hfst -2 tk-tr.twol.hfst -o tr-tk.autogen.hfst
 </pre>

@@ Line 231: / Line 231: @@
 <pre>
-$ hfst-lexc apertium-tr-tk.tk.lexc > tk-tr.lexc.hfst
+$ hfst-lexc apertium-tr-tk.tk.lexc -o tk-tr.lexc.hfst
 </pre>