Difference between revisions of "Turkic languages"

From Apertium
Jump to navigation Jump to search
Line 37: Line 37:
 
| working
 
| working
 
|align="right"|{{:Kymorph/stems}}
 
|align="right"|{{:Kymorph/stems}}
|colspan=3| [[Kymorph#Current State|{{:Kymorph/coverage/average}}]]
+
|colspan="3" align="center"| [[Kymorph#Current State|{{:Kymorph/coverage/average}}]]
 
| [[apertium-tr-ky]] ([[trunk]])
 
| [[apertium-tr-ky]] ([[trunk]])
 
| [[User:Firespeaker|Jonathan]], [[User:gantu|Mirlan]], [[User:Francis Tyers|Fran]]
 
| [[User:Firespeaker|Jonathan]], [[User:gantu|Mirlan]], [[User:Francis Tyers|Fran]]
 
|-
 
|-
  +
| [[turmorph]]
| [[turmorph]] || [[Turkish]] || <code>tr</code> || <code>tur</code> || HFST (lexc+twol) || development ||align="right"| 19,534 ||SETimes||align="right"| 4.1M || ~86.5% || [[turmorph]] ([[branches]]) || [[User:zfe|Gianluca]]
 
  +
| [[Turkish]]
|-
 
  +
| <code>tr</code>
  +
| <code>tur</code>
  +
| HFST (lexc+twol)
  +
| development
  +
|align="right"| {{:Turmorph/stems}}
  +
|colspan="3" align="center"| [[Turmorph#Current State|{{:Turmorph/coverage/average}}]]
  +
| [[turmorph]] ([[branches]])
  +
| [[User:zfe|Gianluca]]
 
|-
 
|-
 
|| [[kazmorph]]
 
|| [[kazmorph]]

Revision as of 18:11, 8 January 2012

The Turkic languages include Turkish, Azeri, Uzbek, Kazakh, Kyrgyz, Tatar, Chuvash, Turkmen, Bashkir, Sakha, and several dozen other languages. The languages are related with varying levels of mutual intelligibility. Our goal is to enhance MT coverage of them with apertium.

The ultimate master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

Status

The ultimate goal is to have multi-purposable transducers for a variety of Turkic languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

Transducers

Once a transducer has ~80% coverage on a range of corpora we can say it is "working". Over 90% and it can be considered to be "production".

name Language ISO 639 formalism state stems coverage location primary authors
-2 -3 corpus words %cov
trmorph Turkish tr tur SFST production 37,300 SETimes 4.1M ~90.6% Çağri
kymorph Kyrgyz ky kir HFST (lexc+twol) working 8,564 ~87.3% apertium-tr-ky (trunk) Jonathan, Mirlan, Fran
turmorph Turkish tr tur HFST (lexc+twol) development 10,971 ~91.1% turmorph (branches) Gianluca
kazmorph Kazakh kk kaz HFST (lexc+twol) development 9,306 94.1 apertium-ky-kk (incubator) Nathan, Jonathan, Fran
baqmorph Bashkir ba bak HFST (lexc+twol) development 2,827 ~66% apertium-tt-ba (nursery) Fran, Jonathan, Milli
tatmorph Tatar tt tat HFST (lexc+twol) development 7,246 ~84.7% apertium-tt-ba (nursery) Fran, Jonathan, Milli
Chuvash cv chv HFST (lexc+twol) development 88 88.8K ~30% apertium-cv-tr (incubator) Hèctor
azmorph Azerbaijani az aze SFST working? - apertium-tr-az (trunk) Gianluca

Pairs

Table of dix progress

Turkic-Turkic pairs

Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in trunk, while text in bold denotes a stable well-working language pair.

tr az tk uz ky kk tt cv ba ug
tr tr-az tr-ky tr-cv
az az-tr
tk
uz
ky ky-tr ky-kk
kk kk-ky kk-tt
tt tt-kk tt-ba
cv cv-tr
ba ba-tt
ug

Pairs with non-Turkic languages

tr az tk uz ky kk tt cv ba ug
en tr-en ky-en
fr
es
it
ru cv-ru
mn mn-kk

Tagset

Rough guide to tagsets in various Turkic language transducers, with an eye to keeping stuff that is basically the same tagged the same. In the following table, A stands for Apertium and T stands for TRmorph.

Phenomenon Morphology Description Tag(s) Language(s) Notes
Part of speech
Noun <n>
Proper noun <np>
Determiner <det>
Numeral <num>
Adjective <adj>
Adverb <adv>
Pronoun <prn>
Verb <v>
Auxiliary verb <vaux>
Copula <cop>
Adverb <adv>
Postadverb <postadv>
Postposition <post>a <postp>t
Particle <part>
Coordinating conjunction <cnjcoo>
Subordinating conjunction <cnjsub>
Adverbial conjunction <cnjadv>
Abbreviation <abbr>
Interjection <ij>
Proper noun types
Toponym <top>
Anthroponym <ant>
Cognomen (Surname) <cog>
Acronym <acr>
Other <al>
Pronoun types
Personal <pers>
Ordinal <ord>
Demonstrative <dem>
Indefinite <ind>
Interrogative <itg>
Reflexive <ref>
Existential <exi>
Quantifier <qnt>
Positive <pst>
Negative <neg>
Comparative <comp>
Collective-numeral <coll>
Reciprocal <recip>
First person <p1>
Second person <p2>
Third person <p3>
Case
Nominative case (unmarked) <nom>
Genitive case <gen>
Dative case <dat>
Locative case <loc>
Ablative case -DAn Case indicating movement away <abl> Pan-turkic
Instrumental case <ins>
Private case <priv>
Terminative case <term>
Final case <fin>
Posession
1st pers sg <px1sg>
1st pers pl <px1pl>
2nd pers sg <px2sg>
2nd pers pl <px2pl>
3rd pers sg <px3sg>
3rd pers pl <px3pl>
3rd pers sg or pl <px3sp>
Gender
Masculine <m>
Feminine <f>
Masculine / feminine <mf>
Number
Singular <sg>
Plural <pl>
Tense, aspect, mood
Present tense <pres>
Present continuous tense <cont> Turkish: -{bI}yor
Evidential past tense <evid> Turkish: -m{I}ş
Past tense <past> Turkish: -{D}{I}
Definite past tense <ifi>
Imperfect <pii> Turkish: Aorist + -m{A}kt{A}
Past habitual tense <pih> Turkish: Aorist + -{D}{I}
Future tense <fut> Turkish: -{bY}{A}c{A}{k}
Imperative Mood for giving orders <imp>A, <t_imp>T Pan-turkic Turkish: -ø
Conditional <cond> Turkish: -s{A}
Aorist <aor> Turkish: -{A}r or -{bI}r
Optative <opt> Turkish: -{bY}{A}, Kirghiz: -мAк>чI
Obligative <oblig> Turkish: -m{A}l{I}
Potential <pot> Kirghiz: -чUдAй
Not-yet tense <notyet> Kirghiz: -E элек
Gerund #1 <ger1> Turkish: -m{A}
Gerund #2 <ger2> Turkish: -m{A}{K}
Gerund #3 <ger3> Turkish: -{D}{I}{k}
Gerund #4 <ger4> Turkish: -{bY}{I}ş
Gerund #5 <ger5> Turkish: -{bY}{A}n
Gerund #6 <ger6> Turkish: -{bY}{A}r{A}k
Gerund #7 <fger> Turkish: -{bY}{I}p
Future gerund #1 <ger1> Turkish: -{bY}{A}c{A}{k}
Imperfect participle #1 <fger> Turkish: -{bY}{A}r{A}{k}
Passive <pass>
Causative <caus>
Cooperative <coop>
Transitivity
Transitive <tv>
Intransitive <iv>