Turkic languages
The Turkic languages include Turkish, Azeri, Uzbek, Uyghur, Kazakh, Kyrgyz, Tatar, Chuvash, Turkmen, Bashkir, Sakha, and several dozen other languages. The languages are related with varying levels of mutual intelligibility. A team called Apertium Turkic aims to enhance MT coverage of these languages with apertium.
The ultimate master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
Status
The ultimate goal is to have multi-purpose transducers for a variety of Turkic languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
Transducers
- See also: Turkic lexicon and Languages
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
name | Language | native name | ISO 639 | formalism | state | stems | coverage | location | primary authors | |
---|---|---|---|---|---|---|---|---|---|---|
-2 | -3 | |||||||||
apertium-kaz
|
Kazakh | қазақ тілі | kk
|
kaz
|
HFST (lexc+twol) | production | 36,595 | ~94.5% | apertium-kaz (languages) | Ilnar, Jonathan, Fran, Aida, Beknazar, Nathan |
apertium-tat
|
Tatar | татар теле | tt
|
tat
|
HFST (lexc+twol) | production | 55,702 | ~91% | apertium-tat (languages) | Ilnar, Fran, Jonathan, Röstäm |
apertium-kir
|
Kyrgyz | кыргыз тили | ky
|
kir
|
HFST (lexc+twol) | working | 14,424 | ~90.4% | apertium-kir (languages) | Jonathan, Mirlan, Fran, Qantörö |
apertium-tur
|
Turkish | Türk dili | tr
|
tur
|
HFST (lexc+twol) | working | 17,221 | ~87.3% | apertium-tur (incubator) | Fran, Gianluca, Jonathan |
apertium-chv |
Chuvash | чӑваш чӗлхи | cv |
chv |
HFST (lexc+twol) | development | 10,267 | ~85% | apertium-chv (languages) | Hèctor |
apertium-kum |
Kumyk | къумукъ тил | - |
kum |
HFST (lexc+twol) | development | 4,918 | ~90.2% | apertium-kum (languages) | Fran, Jonathan |
apertium-kaa
|
Karakalpak | Qaraqalpaq tili | -
|
kaa
|
HFST (lexc+twol) | development | 25,545 | ~86.1% | apertium-kaa (languages) | Beknazar, Fran, Jonathan |
apertium-uzb |
Uzbek | o'zbek tili | uz |
uzb |
HFST (lexc+twol) | development | 34,470 | ~82.9% | apertium-uzb (languages) | |
apertium-bak
|
Bashkir | башҡорт теле | ba
|
bak
|
HFST (lexc+twol) | development | 2,827 | ~66% | apertium-bak (languages) | Fran, Jonathan, Ilnar, Milli |
apertium-nog
|
Nogay | Ногай тили | -
|
nog
|
HFST (lexc+twol) | development | 1,385 | ~81.4% | apertium-nog (languages) | Fran, Jonathan |
apertium-tuk
|
Turkmen | Türkmençe | tk
|
tuk
|
HFST (lexc+twol) | development | 2,988 | ~70.7% | apertium-tuk (languages) | Fran |
apertium-uig
|
Uyghur | ئۇيغۇر تىلى | ug
|
uig
|
HFST (lexc+twol) | prototype | 17,585 | ~54.2% | apertium-uig (incubator) | Jonathan, Märdan, Fran |
apertium-crh
|
Crimean Tatar | Qırımtatar tili | -
|
crh
|
HFST (lexc+twol) | prototype | 11,757 | ~85.4% | apertium-crh (incubator) | Fran |
apertium-sah
|
Yakut | Саха тыла | -
|
sah
|
HFST (lexc+twol) | prototype | 11,531 | ~89.6% | apertium-sah (incubator) | Fran |
apertium-tyv
|
Tuvan | Тыва дыл | -
|
tyv
|
HFST (lexc+twol) | prototype | 11,695 | ~92.7% | apertium-tyv (incubator) | Fran |
apertium-kjh
|
Khakas | Хакас тілі | -
|
kjh
|
HFST (lexc+twol) | prototype | 293 | ~39.3% | apertium-kjh (incubator) | Fran |
apertium-aze
|
Azerbaijani | Azərbaycan dili | az
|
aze
|
HFST (lexc+twol) | prototype | 11,120 | apertium-aze (incubator) | Gianluca |
Turkic languages by subgroup
- Oğuz: Turkish, Azeri, Turkmen, Gagauz, Trukhmen, Bojnur, etc.
- Qarluq: Uzbek, Uyghur
- Qıpçaq:
- West: Kumyk, Karachay-Balkar, Crimean Tatar, Karaim
- North: Tatar, Bashqort
- South (trad. East): Kazakh, Karakalpak, Nogay
- East: Kyrgyz
- Altay: South Altay (, Kyrgyz)
- Yeniseian: Khakas, Shor, Chulym, Baraba Tatar, North Altay
- Sayan: Tuvan, Tofa, Tozhu, Dukha, Soyot
- Lena: Sakha, Dolgan
- Arğu: Halaj
- Oğur: Chuvash
Pairs
Some Turkic languages that are particularly similar to one another (and hence have high levels of mutual intelligibility) include those in the following list:
- Turkish, Azerbaycani, (Turkmen)
- Qazaq, Qaraqalpaq, Noğay, (Qırğız)
- Kumyk, Karachay-Balkar
- Tatar, Bashqort
- Uzbek, Uyğur
- Shor, Khakas(, Altay)
- Sakha, Dolgan
- Tuvan, Tofa
Chuvash is very distant from other Turkic languages and is not even partially mutually intelligible with any of them.
Table of existing pairs
- See also: Turkic-Turkic translator
Text in italics denotes prototype language pairs in the incubator. Regular text denotes a developing language pair in nursery, while text in bold denotes a stable well-working language pair in trunk, and text in bold and italics denotes a pair in staging. Bidix stems as counted with dixcounter are displayed below.
tat | |
---|---|
tat | - |
bak | tat-bak 2,941 |
chv | chv-tat 198 |
kaz | 'kaz-tat ' |
kir | tat-kir |
rus | tat-rus 5,999 |
tur | tur-tat 3,317 |