Twol rules in lttoolbox - Revision history

Techievena: /* Definitions */ Update definition

2018-06-10T16:58:58Z

Definitions: Update definition

2018-06-07T17:03:44Z

Regular Expression Syntax: Fix header and content

2018-06-03T07:04:27Z

Add table format

2018-06-03T05:49:03Z

Add headings

2018-05-24T16:45:12Z

Alphabets: Explain archiphoneme

2018-05-22T03:00:43Z

Twol Rules: constraint --> dir

2018-05-21T17:25:58Z

alternate archiphoneme or sets

2018-05-20T09:17:12Z

Add type of rules

2018-05-20T08:49:36Z

Organise page

2018-05-20T06:09:47Z

Add tag meanings

@@ Line 56: / Line 56: @@
 <pre>
-<sets>
+<defs>
-  <set n="Vowels">aeiou</set>
+  <def n="Vowel_Group"><gr><set n="Vowel"/></gr></def>
-  <set n="BackVow">bcdfg</set>
+  <def n="BackVow_Group"><gr><set n="Vowel"/></gr><set n="BackVow"/></def>
-</sets>
+</defs>
 </pre>
@@ Line 65: / Line 65: @@
 ! Tag/Symbol       !! Meaning
 |-
-| '''set'''        || set/group of alphabets
+| '''def'''        || group/combination of alphabet sets
 |-
-| '''n'''          || set name
+| '''n'''          || definition name
 |-
 |}

@@ Line 159: / Line 159: @@
 |}
-==Regular Expression Synatx==
+==Regular Expression Syntax==
+In hfst-twolc, the following order of precedence is followed in the application of regular expressions:
-Regular expressions in the twolc syntax are handled with the help
+* Unary operators: <code>^INTEGER</code>, <code>$</code>, <code>$.</code>, <code>\</code>, <code>~</code>, <code>*</code>, <code>+</code>
+* Concatenation
+* Binary operators: <code>|</code>, <code>&</code>, <code>-</code>
+It also uses constructions like <code>(...)</code> and <code>[...]</code> which overrides all other order of precedence.
+We therefore separate the regular expressions in lttoolbox into two categories and use different type of tags for regex operators and enclosing operators.
 '''Regular Expression Operators'''
@@ Line 168: / Line 175: @@
 ! Tag/Symbol       !! Meaning
 |-
-| '''set'''        || set/group of alphabets
+| '''re'''         || regular expression operator tag
+|-
+| '''n'''          || regular expression operator name
+|-
+| '''gr'''         || grouping operator
 |-
-| '''n'''          || set name
+| '''gro'''        || grouping operator (optional)
 |-
 |}

@@ Line 162: / Line 162: @@
 Regular expressions in the twolc syntax are handled with the help
+'''Regular Expression Operators'''
+{|class=wikitable
+! Tag/Symbol       !! Meaning
+|-
+| '''set'''        || set/group of alphabets
+|-
+| '''n'''          || set name
+|-
+|}

@@ Line 53: / Line 53: @@
 |}
-==Twol Rules==
+==Definitions==
+<pre>
+<sets>
+  <set n="Vowels">aeiou</set>
+  <set n="BackVow">bcdfg</set>
+</sets>
+</pre>
+{|class=wikitable
+! Tag/Symbol       !! Meaning
+|-
+| '''set'''        || set/group of alphabets
+|-
+| '''n'''          || set name
+|-
+|}
+==Diacritics==
+<pre>
+<sets>
+  <set n="Vowels">aeiou</set>
+  <set n="BackVow">bcdfg</set>
+</sets>
+</pre>
+{|class=wikitable
+! Tag/Symbol       !! Meaning
+|-
+| '''set'''        || set/group of alphabets
+|-
+| '''n'''          || set name
+|-
+|}
+==Rule Definitions==
+<pre>
+<sets>
+  <set n="Vowels">aeiou</set>
+  <set n="BackVow">bcdfg</set>
+</sets>
+</pre>
+{|class=wikitable
+! Tag/Symbol       !! Meaning
+|-
+| '''set'''        || set/group of alphabets
+|-
+| '''n'''          || set name
+|-
+|}
+==Rules==
 <pre>
@@ Line 104: / Line 158: @@
 |-
 |}
+==Regular Expression Synatx==
+Regular expressions in the twolc syntax are handled with the help

@@ Line 23: / Line 23: @@
 <alphabet>аӑеёӗиоуӳыэюябвгджзклмнпрсҫтфхцчшщйьъАӐЕЁӖИОУӲЫЭЮЯБВГДЖЗКЛМНПРСҪТФХЦЧШЩЙЬЪ<ar n="A">ae</ar></alphabet>
 </pre>
+The alphabets within the '''ar''' tags denote all the possible surface form transformations possible for the archiphoneme.
 {|class=wikitable

@@ Line 57: / Line 57: @@
   <rule c="Back vowel harmony for archiphoneme A">
     <m><ar n="A"></m><s>a</s>
-    <context constraint="e"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
+    <context dir="e"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
   </rule>
   <rule c="Only hyphen in vowel boundaries and caps">
     <m><ar n="hyph?"></m><s>-</s>
-    <context constraint="f"><l_c><set n="Vowels"></l_c><r_c></r_c></context>
+    <context dir="f"><l_c><set n="Vowels"></l_c><r_c></r_c></context>
   </rule>
   <rule c="Back vowel harmony for archiphoneme A">
     <m><ar n="A"></m><s>a</s>
-    <context constraint="b"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
+    <context dir="b"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
   </rule>
   <rule c="Back vowel harmony for archiphoneme A">
     <m><ar n="A"></m><s>a</s>
-    <context constraint="ne"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
+    <context dir="ne"><l_c><set n="BackVow"></l_c><r_c></r_c></context>
   </rule>
 </rules>
@@ Line 87: / Line 87: @@
 | '''context'''    || context for transformation
 |-
-| '''constraint''' || direction constraint
+| '''dir'''        || direction constraint
 |-
 | '''f'''          || a:b => _ ;	If the symbol pair a:b appears it must be in context _

@@ Line 4: / Line 4: @@
 ==Guidelines==
-*Every rule in the dictionary file must be properly compatible with the the HFST twolc engine and must not result in any ambiguities.
+*Every rule in the dictionary file must be properly compatible with the the HFST twolc engine and must not result in any kind of ambiguities.
 *The xml tags must be well defined for archiphonemes and rules and must be distinct from the other existing tags in lttoolbox.
 *Every rule entry should have comments adequate enough to give a brief understanding of morphophonological transformations performed by the twol compiler.
@@ Line 18: / Line 18: @@
 **Morphologically conditioned insertion
-==Archiphonemes==
+==Alphabets==
 <pre>
+<alphabet>аӑеёӗиоуӳыэюябвгджзклмнпрсҫтфхцчшщйьъАӐЕЁӖИОУӲЫЭЮЯБВГДЖЗКЛМНПРСҪТФХЦЧШЩЙЬЪ<ar n="A">ae</ar></alphabet>
-<archiphoneme>
-  <ar n="A" alpha="ae"/>
-  <ar n="B" alpha="bcd"/>
-</archiphoneme>
 </pre>
@@ Line 32: / Line 29: @@
 | '''ar'''         || archiphoneme
 |-
-| '''alpha'''      || alphabet
+| '''n'''          || archiphoneme name
 |-
 |}
@@ Line 40: / Line 37: @@
 <pre>
 <sets>
-  <set n="Vowels" alpha="aeiou"/>
+  <set n="Vowels">aeiou</set>
-  <set n="BackVow" alpha="bcdfg"/>
+  <set n="BackVow">bcdfg</set>
 </sets>
 </pre>
@@ Line 52: / Line 49: @@
 | '''n'''          || set name
 |-
-| '''alpha'''      || alphabet
-|-
 |}

@@ Line 10: / Line 10: @@
 ==Design==
 *The design is still in the development stage and may need significant modifications after it is implemented on the existing language pairs.
-*The design must be robust enough to support
+*The design must be robust enough to support all type of rules namely:
+**Phonologically conditioned deletion
+**Morphologically conditioned deletion
+**Phonologically conditioned symbol change
+**Morphologically conditioned symbol change
+**Phonologically conditioned insertion
+**Morphologically conditioned insertion
 ==Archiphonemes==