Difference between revisions of "Replacement for flag diacritics"
Jump to navigation
Jump to search
Firespeaker (talk | contribs) |
|||
| (9 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
People like to use [[flag diacritics]] for stuff. But they are bad because they are ugly and get in the way of stuff. |
People like to use [[flag diacritics]] for stuff. But they are bad because they are ugly and get in the way of stuff. |
||
| − | Alternative: Use symbols and finite-state operations! |
+ | Alternative: Use distinct symbols with well defined behaviours and finite-state operations! |
We have <code><</code> and <code>></code> for morphological tags, and <code>{</code> and <code>}</code> for [[archiphonemes]] and morphological features. We add a new type of symbol with <code>[</code> and <code>]</code> for modelling morphotactic restrictions. |
We have <code><</code> and <code>></code> for morphological tags, and <code>{</code> and <code>}</code> for [[archiphonemes]] and morphological features. We add a new type of symbol with <code>[</code> and <code>]</code> for modelling morphotactic restrictions. |
||
| − | == |
+ | ==Examples== |
| + | |||
| + | ===Turkish=== |
||
<pre> |
<pre> |
||
Multichar_Symbols |
Multichar_Symbols |
||
| − | %<v%> %<cop%> %<tv%> %<aor%> %<prog%> %<p1% %<p3%> %<sg%> |
+ | %<v%> %<cop%> %<tv%> %<aor%> %<prog%> %<p1%> %<p3%> %<sg%> |
%[%-aor%] %[%+aor%] |
%[%-aor%] %[%+aor%] |
||
| − | %+ |
+ | %+ ; |
LEXICON Root |
LEXICON Root |
||
| Line 31: | Line 33: | ||
LEXICON V-TV |
LEXICON V-TV |
||
| − | %<v%>%<tv%>%<aor%>%[%+aor%]: |
+ | %<v%>%<tv%>%<aor%>%[%+aor%]:ir PERS ; |
| − | %<v%>%<tv%>%<aor%>%[%+aor%]: |
+ | %<v%>%<tv%>%<aor%>%[%+aor%]:ir COP ; |
%<v%>%<tv%>%<prog%>%[%-aor%]:iyor COP ; |
%<v%>%<tv%>%<prog%>%[%-aor%]:iyor COP ; |
||
| Line 43: | Line 45: | ||
Alphabet |
Alphabet |
||
| − | b i l m |
+ | a b c d e f g h i j k l m n o p q r s t u v w x y z |
| − | %<v%> %<tv%> %<prog%> %<aor%> %<p1%> %<p2%> %<p3%> %<sg%> %<cop%> |
+ | %<v%> %<tv%> %<prog%> %<aor%> %<p1%> %<p2%> %<p3%> %<sg%> %<cop%> |
| − | %[%+aor%]:0 %[%-aor%]:0 |
+ | %[%+aor%]:0 %[%-aor%]:0 ; |
| − | |||
| ⚫ | |||
Sets |
Sets |
||
| Line 57: | Line 57: | ||
Rules |
Rules |
||
| − | "No consecutive +aor tags" |
+ | "No consecutive [+aor] tags" |
%[%+aor%]:0 /<= %[%+aor%]:0 :* _ ; |
%[%+aor%]:0 /<= %[%+aor%]:0 :* _ ; |
||
</pre> |
</pre> |
||
| Line 68: | Line 68: | ||
biliyorim:bil<v><tv><prog>+i<cop><aor><p1><sg> |
biliyorim:bil<v><tv><prog>+i<cop><aor><p1><sg> |
||
biliyor:bil<v><tv><prog>+i<cop><aor><p3><sg> |
biliyor:bil<v><tv><prog>+i<cop><aor><p3><sg> |
||
| − | + | bilirim:bil<v><tv><aor><p1><sg> |
|
| − | + | bilir:bil<v><tv><aor><p3><sg> |
|
</pre> |
</pre> |
||
| + | |||
| + | ===Persian=== |
||
| + | |||
| + | <pre> |
||
| + | Multichar_Symbols |
||
| + | |||
| + | %<v%> %<tv%> %<pri%> %<cni%> %<prs%> %<p1%> %<p3%> %<sg%> |
||
| + | |||
| + | %[%-prs%] %[%+prs%] %[%-cni%] %[%+cni%] |
||
| + | |||
| + | |||
| + | %+ |
||
| + | |||
| + | LEXICON Root |
||
| + | |||
| + | Prefix ; |
||
| + | |||
| + | LEXICON Prefix |
||
| + | |||
| + | %[%+prs%]%[%-cni%]:be Verbs ; |
||
| + | %[%-prs%]%[%+cni%]:mi Verbs ; |
||
| + | |||
| + | %[%-prs%]%[%-cni%]: Verbs ; |
||
| + | |||
| + | LEXICON PERS |
||
| + | |||
| + | %<p1%>%<sg%>:im # ; |
||
| + | %<p3%>%<sg%>: # ; |
||
| + | |||
| + | LEXICON V-TV |
||
| + | |||
| + | %<v%>%<tv%>%<cni%>%[%+cni%]%[%-prs%]: PERS ; |
||
| + | %<v%>%<tv%>%<prs%>%[%-cni%]%[%+prs%]: PERS ; |
||
| + | %<v%>%<tv%>%<pri%>%[%-cni%]%[%-prs%]: PERS ; |
||
| + | |||
| + | LEXICON Verbs |
||
| + | |||
| + | kardan:kard V-TV ; ! "" |
||
| + | </pre> |
||
| + | |||
| + | <pre> |
||
| + | $ cat prefix-const.twol |
||
| + | |||
| + | Alphabet |
||
| + | |||
| + | a b c d e f g h i j k l m n o p q r s t u v w x y z |
||
| + | |||
| + | %<v%> %<tv%> %<p1%> %<p3%> %<sg%> %<pri%> %<prs%> %<cni%> |
||
| + | |||
| + | %[%+prs%]:0 %[%-prs%]:0 %[%+cni%]:0 %[%-cni%]:0 |
||
| + | |||
| ⚫ | |||
| + | |||
| + | Sets |
||
| + | |||
| + | Verb = %<v%> ; |
||
| + | |||
| + | Rules |
||
| + | |||
| + | "Match prefixes" |
||
| + | Tx:0 /<= Ty:0 :* _ ; |
||
| + | where |
||
| + | Tx in ( %[%+cni%] %[%+prs%] %[%-cni%] %[%-prs%] ) |
||
| + | Ty in ( %[%-cni%] %[%-prs%] %[%+cni%] %[%+prs%] ) matched ; |
||
| + | </pre> |
||
| + | |||
| + | <pre> |
||
| + | $ hfst-lexc prefix.lexc | hfst-invert -o prefix.hfst |
||
| + | $ hfst-twolc prefix-const.twol -o prefix-const.hfst |
||
| + | $ hfst-compose-intersect -1 prefix.hfst -2 prefix-const.hfst | hfst-fst2strings |
||
| + | |||
| + | bekardim:kardan<v><tv><prs><p1><sg> |
||
| + | bekard:kardan<v><tv><prs><p3><sg> |
||
| + | kardim:kardan<v><tv><pri><p1><sg> |
||
| + | kard:kardan<v><tv><pri><p3><sg> |
||
| + | mikardim:kardan<v><tv><cni><p1><sg> |
||
| + | mikard:kardan<v><tv><cni><p3><sg> |
||
| + | |||
| + | </pre> |
||
| + | |||
| + | == See also == |
||
| + | * [[Morphotactic constraints with twol]] |
||
| + | |||
| + | [[Category:Development]] |
||
| + | [[Category:Flag diacritics]] |
||
Latest revision as of 22:04, 7 February 2017
People like to use flag diacritics for stuff. But they are bad because they are ugly and get in the way of stuff.
Alternative: Use distinct symbols with well defined behaviours and finite-state operations!
We have < and > for morphological tags, and { and } for archiphonemes and morphological features. We add a new type of symbol with [ and ] for modelling morphotactic restrictions.
Contents
Examples[edit]
Turkish[edit]
Multichar_Symbols %<v%> %<cop%> %<tv%> %<aor%> %<prog%> %<p1%> %<p3%> %<sg%> %[%-aor%] %[%+aor%] %+ ; LEXICON Root Verbs ; LEXICON PERS %<p1%>%<sg%>:im # ; %<p3%>%<sg%>: # ; LEXICON COP %+i%<cop%>%<aor%>%[%+aor%]: PERS ; LEXICON V-TV %<v%>%<tv%>%<aor%>%[%+aor%]:ir PERS ; %<v%>%<tv%>%<aor%>%[%+aor%]:ir COP ; %<v%>%<tv%>%<prog%>%[%-aor%]:iyor COP ; LEXICON Verbs bil:bil V-TV ; ! ""
Alphabet a b c d e f g h i j k l m n o p q r s t u v w x y z %<v%> %<tv%> %<prog%> %<aor%> %<p1%> %<p2%> %<p3%> %<sg%> %<cop%> %[%+aor%]:0 %[%-aor%]:0 ; Sets Verb = %<v%> ; Rules "No consecutive [+aor] tags" %[%+aor%]:0 /<= %[%+aor%]:0 :* _ ;
$ hfst-lexc test.lexc | hfst-invert -o test.hfst $ hfst-twolc test-const.twol -o const.hfst $ hfst-compose-intersect -1 test.hfst -2 const.hfst | hfst-fst2strings biliyorim:bil<v><tv><prog>+i<cop><aor><p1><sg> biliyor:bil<v><tv><prog>+i<cop><aor><p3><sg> bilirim:bil<v><tv><aor><p1><sg> bilir:bil<v><tv><aor><p3><sg>
Persian[edit]
Multichar_Symbols %<v%> %<tv%> %<pri%> %<cni%> %<prs%> %<p1%> %<p3%> %<sg%> %[%-prs%] %[%+prs%] %[%-cni%] %[%+cni%] %+ LEXICON Root Prefix ; LEXICON Prefix %[%+prs%]%[%-cni%]:be Verbs ; %[%-prs%]%[%+cni%]:mi Verbs ; %[%-prs%]%[%-cni%]: Verbs ; LEXICON PERS %<p1%>%<sg%>:im # ; %<p3%>%<sg%>: # ; LEXICON V-TV %<v%>%<tv%>%<cni%>%[%+cni%]%[%-prs%]: PERS ; %<v%>%<tv%>%<prs%>%[%-cni%]%[%+prs%]: PERS ; %<v%>%<tv%>%<pri%>%[%-cni%]%[%-prs%]: PERS ; LEXICON Verbs kardan:kard V-TV ; ! ""
$ cat prefix-const.twol
Alphabet
a b c d e f g h i j k l m n o p q r s t u v w x y z
%<v%> %<tv%> %<p1%> %<p3%> %<sg%> %<pri%> %<prs%> %<cni%>
%[%+prs%]:0 %[%-prs%]:0 %[%+cni%]:0 %[%-cni%]:0
;
Sets
Verb = %<v%> ;
Rules
"Match prefixes"
Tx:0 /<= Ty:0 :* _ ;
where
Tx in ( %[%+cni%] %[%+prs%] %[%-cni%] %[%-prs%] )
Ty in ( %[%-cni%] %[%-prs%] %[%+cni%] %[%+prs%] ) matched ;
$ hfst-lexc prefix.lexc | hfst-invert -o prefix.hfst $ hfst-twolc prefix-const.twol -o prefix-const.hfst $ hfst-compose-intersect -1 prefix.hfst -2 prefix-const.hfst | hfst-fst2strings bekardim:kardan<v><tv><prs><p1><sg> bekard:kardan<v><tv><prs><p3><sg> kardim:kardan<v><tv><pri><p1><sg> kard:kardan<v><tv><pri><p3><sg> mikardim:kardan<v><tv><cni><p1><sg> mikard:kardan<v><tv><cni><p3><sg>
