Difference between revisions of "Turkic languages"
Firespeaker (talk | contribs) |
|||
(130 intermediate revisions by 5 users not shown) | |||
Line 1: | Line 1: | ||
{{TOCD}} |
{{TOCD}} |
||
The '''Turkic languages''' include [[Turkish]], [[Azeri]], [[Uzbek]], [[Uyghur]], [[Kazakh]], [[Kyrgyz]], [[Tatar]], [[Chuvash]], [[Turkmen]], [[Bashkir]], [[Sakha]], and several dozen other languages. The languages are related with varying levels of mutual intelligibility. A team called [[Apertium Turkic]] aims to enhance MT coverage of these languages |
The '''Turkic languages''' include [[Turkish]], [[Azeri]], [[Uzbek]], [[Uyghur]], [[Kazakh]], [[Kyrgyz]], [[Tatar]], [[Chuvash]], [[Turkmen]], [[Bashkir]], [[Sakha]], [[Crimean Tatar]] and several dozen other languages. The languages are related with varying levels of mutual intelligibility. A team called [[Apertium Turkic]] aims to enhance MT coverage of these languages within Apertium. |
||
The ultimate master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below. |
The ultimate master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below. |
||
==Status== |
==Status== |
||
The ultimate goal is to have multi- |
The ultimate goal is to have multi-purpose transducers and annotated corpora (i.e. treebanks) for a variety of Turkic languages. These can then be paired for X→Y translation with the addition of a [[Constraint Grammar|CG]] for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs. |
||
=== Transducers === |
=== Transducers === |
||
Line 24: | Line 24: | ||
!rowspan=2 class="unsortable"| primary authors |
!rowspan=2 class="unsortable"| primary authors |
||
|-class="sortbottom" |
|-class="sortbottom" |
||
! - |
! -1 |
||
! -3 |
! -3 |
||
|- |
|- |
||
|| <code>[[apertium-kaz]]</code> |
|| <code>[[apertium-kaz]]</code> |
||
|| [[Kazakh]] |
|| [[Kazakh]] |
||
|| {{#lst:apertium-kaz/stats|nativename}} |
|||
|| қазақ тілі |
|||
|| <code>kk</code> |
|| <code>kk</code> |
||
|| <code>kaz</code> |
|| <code>kaz</code> |
||
Line 36: | Line 36: | ||
|align="right"| {{#lst:apertium-kaz/stats|stems}} |
|align="right"| {{#lst:apertium-kaz/stats|stems}} |
||
|align="center"| [[Apertium-kaz#Current_State|~{{:Apertium-kaz/stats/average}}%]] |
|align="center"| [[Apertium-kaz#Current_State|~{{:Apertium-kaz/stats/average}}%]] |
||
|| |
|| {{#lst:apertium-kaz/stats|location}} |
||
|| {{#lst:apertium-kaz/stats|authors}} |
|||
|| [[User:Ilnar.salimzyan|Ilnar]], [[User:Firespeaker|Jonathan]], [[User:Francis Tyers|Fran]], [[User:nathan0n5ire|Nathan]] |
|||
|- |
|- |
||
|| <code>[[apertium-tat]]</code> |
|| <code>[[apertium-tat]]</code> |
||
Line 53: | Line 53: | ||
| <code>[[apertium-kir]]</code> |
| <code>[[apertium-kir]]</code> |
||
| [[Kyrgyz]] |
| [[Kyrgyz]] |
||
|| {{#lst:apertium-kir/stats|nativename}} |
|||
| кыргыз тили |
|||
| <code>ky</code> |
| <code>ky</code> |
||
| <code>kir</code> |
| <code>kir</code> |
||
Line 60: | Line 60: | ||
|align="right"| {{#lst:apertium-kir/stats|stems}} |
|align="right"| {{#lst:apertium-kir/stats|stems}} |
||
|align="center"| [[apertium-kir#Current_State|~{{:Apertium-kir/stats/average}}%]] |
|align="center"| [[apertium-kir#Current_State|~{{:Apertium-kir/stats/average}}%]] |
||
| |
|| {{#lst:apertium-kir/stats|location}} |
||
|| {{#lst:apertium-kir/stats|authors}} |
|||
| [[User:Firespeaker|Jonathan]], [[User:gantu|Mirlan]], [[User:Francis Tyers|Fran]] |
|||
|- |
|||
| <code>[[apertium-tyv]]</code> |
|||
|| [[Tuvan]] |
|||
|| {{#lst:apertium-tyv/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>tyv</code> |
|||
|| HFST (lexc+twol) |
|||
|| working |
|||
|align="right"| {{#lst:apertium-tyv/stats|stems}} |
|||
|align="center"| [[apertium-tyv#Current_State|~{{:apertium-tyv/stats/average}}%]] |
|||
|| {{#lst:apertium-tyv/stats|location}} |
|||
|| {{#lst:apertium-tyv/stats|authors}} |
|||
|- |
|- |
||
| <code>[[apertium-tur]]</code> |
| <code>[[apertium-tur]]</code> |
||
Line 69: | Line 81: | ||
| <code>tur</code> |
| <code>tur</code> |
||
| HFST (lexc+twol) |
| HFST (lexc+twol) |
||
| |
| development |
||
|align="right"| {{#lst:Apertium-tur/stats|stems}} |
|align="right"| {{#lst:Apertium-tur/stats|stems}} |
||
|align="center"| [[Turmorph#Current State|~{{:Apertium-tur/stats/average}}%]] |
|align="center"| [[Turmorph#Current State|~{{:Apertium-tur/stats/average}}%]] |
||
| [[apertium-tur]] ([[incubator]]) |
| [[apertium-tur]] ([[incubator]]) |
||
| [[User:Francis Tyers|Fran]], [[User:zfe|Gianluca]] |
| [[User:Francis Tyers|Fran]], [[User:zfe|Gianluca]], [[User:Firespeaker|Jonathan]] |
||
|- |
|- |
||
| <code>[[apertium-crh]]</code> |
|||
| <code>[[apertium-chv]]</code> || [[Chuvash]] || чӑваш чӗлхи || <code>cv</code> || <code>chv</code> || HFST (lexc+twol) || development ||align="right"| {{:apertium-chv/stems}} ||align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]] || [[apertium-chv]] ([[languages]]) || [[User:Hectoralos|Hèctor]] |
|||
|| [[Crimean Tatar|Crimean Tatar]] |
|||
|| {{#lst:apertium-crh/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>crh</code> |
|||
|| HFST (lexc+twol) |
|||
|| development |
|||
|align="right"| {{#lst:apertium-crh/stats|stems}} |
|||
|align="center"| [[apertium-crh#Current_State|~{{:apertium-crh/stats/average}}%]] |
|||
|| {{#lst:apertium-crh/stats|location}} |
|||
|| {{#lst:apertium-crh/stats|authors}} |
|||
|- |
|||
| <code>[[apertium-chv]]</code> || [[Chuvash]] || чӑваш чӗлхи || <code>cv</code> || <code>chv</code> || HFST (lexc+twol) || development ||align="right"| {{#lst:apertium-chv/stats|stems}} ||align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]] || [[apertium-chv]] ([[languages]]) || [[User:Hectoralos|Hèctor]] |
|||
|- |
|||
| <code>[[apertium-sah]]</code> |
|||
|| [[Sakha]] |
|||
|| {{#lst:apertium-sah/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>sah</code> |
|||
|| HFST (lexc+twol) |
|||
|| development |
|||
|align="right"| {{#lst:apertium-sah/stats|stems}} |
|||
|align="center"| [[apertium-sah#Current_State|~{{:apertium-sah/stats/average}}%]] |
|||
|| {{#lst:apertium-sah/stats|location}} |
|||
|| {{#lst:apertium-sah/stats|authors}} |
|||
|- |
|- |
||
| <code>[[apertium-kum]]</code> || [[Kumyk]] || къумукъ тил || <code>-</code> || <code>kum</code> || HFST (lexc+twol) || development ||align="right"|{{#lst:apertium-kum/stats|stems}} ||align="center"| [[apertium-kum#Current_State|~{{:apertium-kum/stats/average}}%]] || [[apertium-kum]] ([[languages]]) || [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
| <code>[[apertium-kum]]</code> || [[Kumyk]] || къумукъ тил || <code>-</code> || <code>kum</code> || HFST (lexc+twol) || development ||align="right"|{{#lst:apertium-kum/stats|stems}} ||align="center"| [[apertium-kum#Current_State|~{{:apertium-kum/stats/average}}%]] || [[apertium-kum]] ([[languages]]) || [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
||
|- |
|||
| <code>[[apertium-kaa]]</code> |
|||
|| [[Karakalpak]] |
|||
|| {{#lst:apertium-kaa/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>kaa</code> |
|||
|| HFST (lexc+twol) |
|||
|| {{#lst:apertium-kaa/stats|state}} |
|||
|align="right"| {{#lst:apertium-kaa/stats|stems}} |
|||
|align="center"| [[apertium-kaa#Current_State|~{{:apertium-kaa/stats/average}}%]] |
|||
|| {{#lst:apertium-kaa/stats|location}} |
|||
|| {{#lst:apertium-kaa/stats|authors}} |
|||
|- |
|- |
||
| <code>[[apertium-uzb]]</code> || [[Uzbek]] || o'zbek tili || <code>uz</code> || <code>uzb</code> || HFST (lexc+twol) || development ||align="right"| {{#lst:apertium-uzb/stats|stems}}||align="center"|[[apertium-uzb#Current_State|~{{:apertium-uzb/stats/average}}%]] || [[apertium-uzb]] ([[languages]]) || |
| <code>[[apertium-uzb]]</code> || [[Uzbek]] || o'zbek tili || <code>uz</code> || <code>uzb</code> || HFST (lexc+twol) || development ||align="right"| {{#lst:apertium-uzb/stats|stems}}||align="center"|[[apertium-uzb#Current_State|~{{:apertium-uzb/stats/average}}%]] || [[apertium-uzb]] ([[languages]]) || |
||
|- |
|||
| <code>[[apertium-krc]]</code> |
|||
|| [[Karachay-Balkar]] |
|||
|| Къарачай-Малкъар тил |
|||
|| <code>-</code> |
|||
|| <code>krc</code> |
|||
|| HFST (lexc+twol) |
|||
|| development |
|||
|align="right"| {{#lst:apertium-krc/stats|stems}} |
|||
|align="center"| [[apertium-krc#Current_State|~{{:apertium-krc/stats/average}}%]] |
|||
|| [[apertium-krc]] ([[incubator]]) |
|||
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
|||
|- |
|- |
||
|| <code>[[apertium-bak]]</code> |
|| <code>[[apertium-bak]]</code> |
||
Line 104: | Line 164: | ||
|| [[apertium-nog]] ([[languages]]) |
|| [[apertium-nog]] ([[languages]]) |
||
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
||
|- |
|||
| <code>[[apertium-gag]]</code> |
|||
|| [[Gagauz]] |
|||
|| Gagauz dili |
|||
|| <code>-</code> |
|||
|| <code>gag</code> |
|||
|| HFST (lexc+twol) |
|||
|| prototype |
|||
|align="right"| {{#lst:apertium-gag/stats|stems}} |
|||
|align="center"| [[apertium-gag#Current_State|~{{:apertium-gag/stats/average}}%]] |
|||
|| [[apertium-gag]] ([[incubator]]) |
|||
|| [[User:Francis Tyers|Fran]] [[User:Purplemoon|Sevilay]] |
|||
|- |
|- |
||
| <code>[[apertium-tuk]]</code> |
| <code>[[apertium-tuk]]</code> |
||
Line 117: | Line 189: | ||
|| [[User:Francis Tyers|Fran]] |
|| [[User:Francis Tyers|Fran]] |
||
|- |
|- |
||
| <code>[[apertium- |
| <code>[[apertium-uig]]</code> |
||
|| [[Karakalpak]] |
|||
|| Qaraqalpaq tili |
|||
|| <code>-</code> |
|||
|| <code>kaa</code> |
|||
|| HFST (lexc+twol) |
|||
|| prototype |
|||
|align="right"| {{#lst:apertium-kaa/stats|stems}} |
|||
|align="center"| [[apertium-kaa#Current_State|~{{:apertium-kaa/stats/average}}%]] |
|||
|| [[apertium-kaa]] ([[incubator]]) |
|||
|| Beknazar, [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]] |
|||
|- |
|||
| <code>[[apertium-uig]]</code> |
|||
|| [[Uyghur]] |
|| [[Uyghur]] |
||
|| {{#lst:apertium-uig/stats|nativename}} |
|||
|| ئۇيغۇر تىلى |
|||
|| <code>ug</code> |
|| <code>ug</code> |
||
|| <code>uig</code> |
|| <code>uig</code> |
||
|| HFST (lexc+twol) |
|| HFST (lexc+twol) |
||
|| {{#lst:apertium-uig/stats|state}} |
|||
|| prototype |
|||
|align="right"| {{#lst:apertium-uig/stats|stems}} |
|align="right"| {{#lst:apertium-uig/stats|stems}} |
||
|align="center"| [[apertium-uig#Current_State|~{{:apertium-uig/stats/average}}%]] |
|align="center"| [[apertium-uig#Current_State|~{{:apertium-uig/stats/average}}%]] |
||
|| |
|| {{#lst:apertium-uig/stats|location}} |
||
|| {{#lst:apertium-uig/stats|authors}} |
|||
|| [[User:Firespeaker|Jonathan]], Märdan, [[User:Francis Tyers|Fran]] |
|||
|- |
|- |
||
| <code>[[apertium- |
| <code>[[apertium-alt]]</code> |
||
|| [[ |
|| [[Altay]] |
||
|| Алтай тили |
|||
|| Qırımtatar tili |
|||
|| |
|| - |
||
|| <code> |
|| <code>alt</code> |
||
|| HFST (lexc+twol) |
|| HFST (lexc+twol) |
||
|| prototype |
|| prototype |
||
|align="right"| {{#lst:apertium- |
|align="right"| {{#lst:apertium-alt/stats|stems}} |
||
|align="center"| [[apertium- |
|align="center"| [[apertium-alt#Current_State|~{{:apertium-alt/stats/average}}%]] |
||
|| [[apertium- |
|| [[apertium-alt]] ([[incubator]]) |
||
|| [[User: |
|| [[User:Firespeaker|Jonathan]], D Tokmashev |
||
|- |
|- |
||
| <code>[[apertium- |
| <code>[[apertium-kjh]]</code> |
||
|| [[ |
|| [[Khakas]] |
||
|| Хакас тілі |
|||
|| Саха тыла |
|||
|| <code>-</code> |
|| <code>-</code> |
||
|| <code> |
|| <code>kjh</code> |
||
|| HFST (lexc+twol) |
|| HFST (lexc+twol) |
||
|| prototype |
|| prototype |
||
|align="right"| {{#lst:apertium- |
|align="right"| {{#lst:apertium-kjh/stats|stems}} |
||
|align="center"| [[apertium- |
|align="center"| [[apertium-kjh#Current_State|~{{:apertium-kjh/stats/average}}%]] |
||
|| [[apertium- |
|| [[apertium-kjh]] ([[incubator]]) |
||
|| [[User:Francis Tyers|Fran]] |
|| [[User:Francis Tyers|Fran]] |
||
|- |
|- |
||
| <code>[[apertium- |
| <code>[[apertium-ota]]</code> |
||
|| [[Ottoman Turkish|Ottoman Turkish]] |
|||
|| [[Tuvan]] |
|||
|| لسان عثمانى |
|||
|| Тыва дыл |
|||
|| <code>-</code> |
|| <code>-</code> |
||
|| <code> |
|| <code>ota</code> |
||
|| HFST (lexc+twol) |
|| HFST (lexc+twol) |
||
|| prototype |
|| prototype |
||
|align="right"| {{#lst:apertium- |
|align="right"| {{#lst:apertium-ota/stats|stems}} |
||
|align="center"| [[apertium- |
|align="center"| [[apertium-ota#Current_State|~{{:apertium-ota/stats/average}}%]] |
||
|| [[apertium- |
|| [[apertium-ota]] ([[incubator]]) |
||
|| [[User:Francis Tyers|Fran]] |
|| [[User:Francis Tyers|Fran]] |
||
|- |
|- |
||
Line 182: | Line 242: | ||
|| <code>az</code> |
|| <code>az</code> |
||
|| <code>aze</code> |
|| <code>aze</code> |
||
|| HFST (lexc+twol) |
|||
|| SFST |
|||
|| prototype |
|||
|| not known to work |
|||
|align="right"| {{#lst:apertium-aze/stats|stems}} |
|||
|| |
|||
|| |
|| |
||
|| [[apertium |
|| [[apertium-aze]] ([[incubator]]) |
||
|| [[User:zfe|Gianluca]] |
|| [[User:zfe|Gianluca]] |
||
|} |
|||
=== Annotated corpora === |
|||
{| class="wikitable sortable" |
|||
|- |
|||
!rowspan=2| name |
|||
!rowspan=2| Language |
|||
!rowspan=2| native name |
|||
!colspan=2 class="unsortable"| ISO 639 |
|||
!rowspan=2| |
|||
!colspan=2| disambiguated |
|||
!colspan=2| dep-annotated |
|||
!rowspan=2| avg. length |
|||
!rowspan=2| location |
|||
!rowspan=2 class="unsortable"| primary authors |
|||
|-class="sortbottom" |
|||
! -2 |
|||
! -3 |
|||
! sent |
|||
!tokens |
|||
! sent |
|||
!tokens |
|||
|- |
|||
|| <code>[[apertium-kaz]]</code> |
|||
|| [[Kazakh]] |
|||
|| {{#lst:apertium-kaz/stats|nativename}} |
|||
|| <code>kk</code> |
|||
|| <code>kaz</code> |
|||
|| |
|||
|align="right"| - |
|||
|align="right"| - |
|||
|align="right"|403 |
|||
|align="right"|5086 |
|||
|| |
|||
|| {{#lst:apertium-kaz/stats|location}} |
|||
|| Jonathan, Fran |
|||
|- |
|||
|| <code>[[apertium-tyv]]</code> |
|||
|| [[Tuvan]] |
|||
|| {{#lst:apertium-tyv/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>tyv</code> |
|||
|| |
|||
|align="right"| - |
|||
|align="right"| - |
|||
|align="right"|115 |
|||
|align="right"|639 |
|||
|| |
|||
|| {{#lst:apertium-tyv/stats|location}} |
|||
|| Jonathan, Fran |
|||
|- |
|||
|| <code>[[apertium-crh]]</code> |
|||
|| [[Crimean Tatar]] |
|||
|| {{#lst:apertium-crh/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>crh</code> |
|||
|| |
|||
|align="right"| - |
|||
|align="right"| - |
|||
|align="right"|150 |
|||
|align="right"|855 |
|||
|align="right"|5.7 |
|||
|| {{#lst:apertium-crh/stats|location}} |
|||
|| Fran |
|||
|- |
|||
|| <code>[[apertium-krc]]</code> |
|||
|| [[Karachay-Balkar]] |
|||
|| {{#lst:apertium-krc/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>krc</code> |
|||
|| |
|||
|align="right"| - |
|||
|align="right"| - |
|||
|align="right"|17 |
|||
|align="right"|116 |
|||
|align="right"|6.8 |
|||
|| {{#lst:apertium-krc/stats|location}} |
|||
|| Fran |
|||
|- |
|||
|| <code>[[apertium-uig]]</code> |
|||
|| [[Uyghur]] |
|||
|| {{#lst:apertium-uig/stats|nativename}} |
|||
|| <code>-</code> |
|||
|| <code>uig</code> |
|||
|| |
|||
|align="right"| 123 |
|||
|align="right"| 951 |
|||
|align="right"|27 |
|||
|align="right"|191 |
|||
|align="right"|7.1 |
|||
|| {{#lst:apertium-uig/stats|location}} |
|||
|| Fran |
|||
|- |
|||
|} |
|} |
||
=== Turkic languages by subgroup === |
=== Turkic languages by subgroup === |
||
* Oğuz: [[Turkish]], [[Azeri]], [[Turkmen]], [[Gagauz]], [[Trukhmen]], [[Bojnur]], etc. |
* Oğuz: [[Turkish]], [[Azeri]], [[Turkmen]], [[Gagauz]], [[Trukhmen]], [[Afshar]], [[Qashqai]], [[Bojnur]], etc. |
||
* Qarluq: [[Uzbek]], [[Uyghur]] |
* Qarluq: [[Uzbek]], [[Uyghur]] |
||
* Qıpçaq |
* Qıpçaq: |
||
** |
** West: [[Kumyk]], [[Karachay-Balkar]], [[Crimean Tatar]], [[Karaim]] |
||
** North: [[Tatar]], [[Bashqort]] |
** North: [[Tatar]], [[Bashqort]] |
||
** |
** South (trad. East): [[Kazakh]], [[Karakalpak]], [[Nogay]] |
||
* |
** East: [[Kyrgyz]] |
||
* |
* Altay: [[South Altay]] (, [[Kyrgyz]]) |
||
* Yeniseian: [[Khakas]], [[Shor]], [[Chulym]], [[Baraba Tatar]], [[North Altay]] |
|||
* Sayan: [[Tuvan]], [[Tofa]], [[Tozhu]], [[Dukha]], [[Soyot]] |
* Sayan: [[Tuvan]], [[Tofa]], [[Tozhu]], [[Dukha]], [[Soyot]] |
||
* Lena: [[Sakha]], [[Dolgan]] |
* Lena: [[Sakha]], [[Dolgan]] |
||
Line 206: | Line 362: | ||
=== Pairs === |
=== Pairs === |
||
Some Turkic languages that are particularly similar to one another (and hence have |
Some Turkic languages that are particularly similar to one another (and hence have varying degrees of mutual intelligibility) include those in the following list: |
||
* [[Turkish]], Azerbaycani, (Turkmen) |
* [[Turkish]], Azerbaycani, (Turkmen) |
||
* [[Kazakh|Qazaq]], Qaraqalpaq, Noğay, ([[Kyrgyz|Qırğız]]) |
* [[Kazakh|Qazaq]], Qaraqalpaq, Noğay, ([[Kyrgyz|Qırğız]]) |
||
Line 220: | Line 376: | ||
==== Table of existing pairs ==== |
==== Table of existing pairs ==== |
||
{{see-also|Turkic-Turkic translator}} |
{{see-also|Turkic-Turkic translator}} |
||
Text in ''italics'' denotes language pairs in the incubator. Regular text denotes a developing language pair in nursery, while text in '''bold''' denotes a stable well-working language pair in trunk and text in '''''bold and italics''''' denotes a pair in staging. Bidix stems as counted with [[dixcounter]] are displayed below. |
Text in ''italics'' denotes prototype language pairs in the incubator. Regular text denotes a developing language pair in nursery, while text in '''bold''' denotes a stable well-working language pair in trunk, and text in '''''bold and italics''''' denotes a pair in staging. Bidix stems as counted with [[dixcounter]] are displayed below. |
||
<center> |
|||
{| style="text-align: center;" class="wikitable" |
|||
{| style="text-align: center;" class="wikitable dixtable" |
|||
|- style="background: #ececec" |
|- style="background: #ececec" |
||
! !! tur !! aze !! tuk !! uzb !! kir !! kaz !! tat !! bak !! chv !! nog !! kaa !! kum !! uig |
! !! tur !! aze !! tuk !! uzb !! kir !! kaz !! tat !! bak !! chv !! nog !! kaa !! kum !! uig !! krc !! crh !! gag !! sah !! tyv !! kjh |
||
|- |
|||
| '''tur''' || - || [[Apertium-tur-aze|tur-aze]]<br>{{#lst:Apertium-tur-aze/stats|tur-aze_stems}} || [[Apertium-tuk-tur|tuk-tur]]<br>{{#lst:Apertium-tuk-tur/stats|tuk-tur_stems}} || [[Apertium-tur-uzb|tur-uzb]]<br>{{#lst:Apertium-tur-uzb/stats|tur-uzb_dix_stems}} || [[Apertium-tur-kir|tur-kir]]<br>{{#lst:Apertium-tur-kir/stats|tur-kir_stems}} || ''[[Apertium-kaz-tur|kaz-tur]]''<br>{{#lst:Apertium-kaz-tur/stats|kaz-tur_stems}} || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_dix_stems}} || || ''[[Apertium-cv-tr|chv-tur]]''<br>{{#lst:Apertium-chv-tur/stats|chv-tur_dix_stems}} || || || || [[Apertium-uig-tur|uig-tur]]<br>{{#lst:Apertium-uig-tur/stats|uig-tur_dix_stems}} || || '''[[Apertium-crh-tur|crh-tur]]'''<br>'''{{#lst:Apertium-crh-tur/stats|crh-tur_dix_stems}}''' || || || || |
|||
|- |
|||
| '''aze''' || [[Apertium-tur-aze|tur-aze]]<br>{{#lst:Apertium-tur-aze/stats|tur-aze_stems}} || - || || || || || || || || || || || || || || || || || |
|||
|- |
|||
| '''tuk''' || [[Apertium-tuk-tur|tuk-tur]]<br>{{#lst:Apertium-tuk-tur/stats|tuk-tur_stems}} || || - || || || || || || || || || || || || || || || || |
|||
|- |
|||
| '''uzb''' || [[Apertium-tur-uzb|tur-uzb]]<br>{{#lst:Apertium-tur-uzb/stats|tur-uzb_dix_stems}} || || || - || ''[[Apertium-kir-uzb|kir-uzb]]''<br>{{#lst:Apertium-kir-uzb/stats|kir-uzb_dix_stems}} || || || || || || ''[[Apertium-uzb-kaa|uzb-kaa]]''<br>{{#lst:Apertium-uzb-kaa/stats|uzb-kaa_dix_stems}} || || || || || || || || |
|||
|- |
|||
| '''kir''' || [[Apertium-tur-kir|tur-kir]]<br>{{#lst:Apertium-tur-kir/stats|tur-kir_stems}} || || || ''[[Apertium-kir-uzb|kir-uzb]]''<br>{{#lst:Apertium-kir-uzb/stats|kir-uzb_dix_stems}} || - || [[Apertium-kaz-kir|kaz-kir]]<br>{{#lst:Apertium-kaz-kir/stats|kaz-kir_dix_stems}} || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_dix_stems}} || || || || || || || || || || || || |
|||
|- |
|||
| '''kaz''' || ''[[Apertium-kaz-tur|kaz-tur]]''<br>{{#lst:Apertium-kaz-tur/stats|kaz-tur_stems}} || || || || [[Apertium-kaz-kir|kaz-kir]]<br>{{#lst:Apertium-kaz-kir/stats|kaz-kir_dix_stems}} || - || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_dix_stems}}''' || || || ''[[Apertium-nog-kaz|nog-kaz]]''<br>{{#lst:Apertium-nog-kaz/stats|nog-kaz_stems}} || ''[[Apertium-kaz-kaa|kaz-kaa]]''<br>{{#lst:Apertium-kaz-kaa/stats|kaz-kaa_stems}} || [[Apertium-kaz-kum|kaz-kum]]<br>{{#lst:Apertium-kaz-kum/stats|kaz-kum_stems}} || ''[[Apertium-kaz-uig|kaz-uig]]''<br>{{#lst:Apertium-kaz-uig/stats|kaz-uig_stems}} || || || || ''[[Apertium-kaz-sah|kaz-sah]]''<br>{{#lst:Apertium-kaz-sah/stats|kaz-sah_dix_stems}} || ''[[Apertium-kaz-tyv|kaz-tyv]]''<br>{{#lst:Apertium-kaz-tyv/stats|kaz-tyv_stems}} || |
|||
|- |
|||
| '''tat''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_dix_stems}} || || || || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_dix_stems}} || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_dix_stems}}''' || - || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_dix_stems}} || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_dix_stems}} || || || || || || || || || || |
|||
|- |
|- |
||
| ''' |
| '''bak''' || || || || || || || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_dix_stems}} || - || || || || || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''chv''' || ''[[Apertium-cv-tr|chv-tur]]''<br>{{#lst:Apertium-chv-tur/stats|chv-tur_dix_stems}} || || || || || || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_dix_stems}} || || - || || || || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''nog''' || || || || || || ''[[Apertium-nog-kaz|nog-kaz]]''<br>{{#lst:Apertium-nog-kaz/stats|nog-kaz_stems}} || || || || - || || || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''kaa''' || || || || ''[[Apertium-uzb-kaa|uzb-kaa]]''<br>{{#lst:Apertium-uzb-kaa/stats|uzb-kaa_dix_stems}} || || ''[[Apertium-kaz-kaa|kaz-kaa]]''<br>{{#lst:Apertium-kaz-kaa/stats|kaz-kaa_stems}} || || || || || - || || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''kum''' || || || || || || [[Apertium-kaz-kum|kaz-kum]]<br>{{#lst:Apertium-kaz-kum/stats|kaz-kum_stems}} || || || || || || - || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''uig''' || [[Apertium-uig-tur|uig-tur]]<br>{{#lst:Apertium-uig-tur/stats|uig-tur_dix_stems}} || || || || || ''[[Apertium-kaz-uig|kaz-uig]]''<br>{{#lst:Apertium-kaz-uig/stats|kaz-uig_stems}} || || || || || || || - || || || || || || |
||
|- |
|- |
||
| '''krc''' || || || || || || || || || || || || || || - || || || || || |
|||
| '''tat''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat-stems}} || || || || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir-stems}} || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat-stems}}''' || - || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak-stems}} || ''[[Apertium-cv-tt|cv-tt]]''<br>{{#lst:Apertium-cv-tt/stats|cv-tt-stems}} || || || || |
|||
|- |
|- |
||
| ''' |
| '''crh''' || '''[[Apertium-crh-tur|crh-tur]]'''<br>'''{{#lst:Apertium-crh-tur/stats|crh-tur_dix_stems}}''' || || || || || || || || || || || || || || - || || || || |
||
|- |
|- |
||
| ''' |
| '''gag''' || || || || || || || || || || || || || || || || - || || || |
||
|- |
|- |
||
| ''' |
| '''sah''' || || || || || || ''[[Apertium-kaz-sah|kaz-sah]]''<br>{{#lst:Apertium-kaz-sah/stats|kaz-sah_dix_stems}} || || || || || || || || || || || - || || |
||
|- |
|- |
||
| ''' |
| '''tyv''' || || || || || || ''[[Apertium-kaz-tyv|kaz-tyv]]''<br>{{#lst:Apertium-kaz-tyv/stats|kaz-tyv_stems}} || || || || || || || || || || || || - || |
||
|- |
|- |
||
| ''' |
| '''kjh''' || || || || || || || || || || || || || || || || || || || - |
||
|- |
|- |
||
| |
| || || || || || || || || || || || || || || || || || || || |
||
|- |
|- |
||
| '''eng''' || ''[[Apertium-tr-en|tr-en]]''<br>{{#lst:Apertium-tr-en/stats|tr-en_stems}} || || || || ''[[Apertium-eng-kir|eng-kir]]''<br>{{#lst:Apertium-eng-kir/stats|eng-kir_dix_stems}} || '''[[Apertium-eng-kaz|eng-kaz]]'''<br>'''{{#lst:Apertium-eng-kaz/stats|eng-kaz_dix_stems}}''' || ''[[Apertium-tat-eng|tat-eng]]''<br>{{#lst:Apertium-tat-eng/stats|tat-eng_dix_stems}} || || || || || || || || || || ''[[Apertium-sah-eng|sah-eng]]''<br>{{#lst:Apertium-sah-eng/stats|sah-eng_dix_stems}} || || |
|||
| || || || || || || || || || || || || || |
|||
|- |
|- |
||
| ''' |
| '''epo''' || ''[[Apertium-eo-tr|eo-tr]]''<br>{{#lst:Apertium-eo-tr/stats|eo-tr_stems}} || || || || || || || || || || || || || || || || || || |
||
|- |
|- |
||
| ''' |
| '''fin''' || ''[[Apertium-tur-fin|tur-fin]]''<br>{{#lst:Apertium-tur-fin/stats|tur-fin_stems}} || || || || || || || || || || || || || || || || || || |
||
|- |
|- |
||
| '''khk''' || || || || || || ''[[Apertium-khk-kaz|khk-kaz]]''<br>{{#lst:Apertium-khk-kaz/stats|khk- |
| '''khk''' || || || || || || ''[[Apertium-khk-kaz|khk-kaz]]''<br>{{#lst:Apertium-khk-kaz/stats|khk-kaz_stems}} || || || || || || || || || || || || || |
||
|- |
|- |
||
| '''rus''' || || || || || || |
| '''rus''' || || || || || || '''[[Apertium-kaz-rus|kaz-rus]]'''<br>'''{{#lst:Apertium-kaz-rus/stats|kaz-rus_dix_stems}}''' || [[Apertium-tat-rus|tat-rus]]<br>{{#lst:Apertium-tat-rus/stats|tat-rus_dix_stems}} || || ''[[Apertium-cv-ru|cv-ru]]''<br>{{#lst:Apertium-cv-ru/stats|cv-ru_stems}} || || || || || || || || || || |
||
|} |
|} |
||
</center> |
|||
=== Roadmap === |
=== Roadmap === |
||
Line 275: | Line 447: | ||
* Expand apertium-chv |
* Expand apertium-chv |
||
* Basic transducers for: |
* Basic transducers for: |
||
** <s>Qaraqalpaq (based on <s>Tatar</s> Kazakh, probably, no?)</s> |
|||
** Khakas |
|||
** Tuvan |
|||
** [[Sakha]] |
|||
** Shor |
|||
** Qaraqalpaq (based on <s>Tatar</s> Kazakh, probably, no?) |
|||
** <s>Uzbek</s> |
** <s>Uzbek</s> |
||
** <s>Uyghur</s> |
** <s>Uyghur</s> |
||
** <s>[[Nogay]]</s> |
** <s>[[Nogay]]</s> |
||
** <s>[[Kumyk]]</s> |
** <s>[[Kumyk]]</s> |
||
** Khakas |
|||
** <s>[[Tuvan]]</s> |
|||
** <s>[[Sakha]]</s> |
|||
** Shor |
|||
** <s>[[Crimean Tatar]]</s> |
|||
==Getting involved== |
==Getting involved== |
||
Line 300: | Line 473: | ||
|| Tatar || Барлык кешеләр дә азат һәм үз абруйлары һәм хокуклары ягыннан тиң булып туалар. Аларга акыл һәм вөҗдан бирелгән һәм бер-берсенә карата туганнарча мөнәсәбәттә булырга тиешләр. |
|| Tatar || Барлык кешеләр дә азат һәм үз абруйлары һәм хокуклары ягыннан тиң булып туалар. Аларга акыл һәм вөҗдан бирелгән һәм бер-берсенә карата туганнарча мөнәсәбәттә булырга тиешләр. |
||
|- |
|- |
||
|| |
|| Kyrgyz || Бардык адамдар өз беделинде жана укуктарында эркин жана тең укуктуу болуп жаралат. Алардын аң‐сезими менен абийири бар жана бири‐бирине бир туугандык мамилекылууга тийиш. |
||
|- |
|- |
||
|| Turkish || Bütün insanlar hür, haysiyet ve haklar bakımından eşit doğarlar. Akıl ve vicdana sahiptirler ve birbirlerine karşı kardeşlik zihniyeti ile hareket etmelidirler. |
|| Turkish || Bütün insanlar hür, haysiyet ve haklar bakımından eşit doğarlar. Akıl ve vicdana sahiptirler ve birbirlerine karşı kardeşlik zihniyeti ile hareket etmelidirler. |
||
|- |
|- |
||
|| Azerbaijani || Bütün insanlar ləyaqət və hüquqlarına görə azad və bərabər doğulurlar. Onların şüurları və vicdanları var və bir-birlərinə münasibətdə qardaşlıq ruhunda davranmalıdırlar. |
|||
|| Uzbek (Latin) || Barcha odamlar erkin, qadr-qimmat ba huquqlarda tang bo'lib tug'iladilar. Ular aql va vijdon sohibidilar va bir-birla iga birodarlarcha muomala qilishlari zarur. |
|||
|- |
|||
|| Gagauz || İnsannar hepsi duuêrlar serbest hem birtakım kendi kıymetindä hem haklarında. Onnara verilmiş akıl hem üz da läazım biri-birinä davransınnar kardaşlık ruhuna uygun. |
|||
|- |
|||
|| Turkmen || Adamlaryň hemmesi azat dogulýarlar we öz mertebesi hem-de hukuklary boýunça ilkibaşdan deňdirler. Olara ozal-başdan aň, ynsap berlendir we biri-birine özara doganlyk ruhunda çemeleşmek olaryň ýaraşygydyr. |
|||
|- |
|||
|| Uzbek (Latin script) || Barcha odamlar erkin, qadr-qimmat ba huquqlarda tang bo'lib tug'iladilar. Ular aql va vijdon sohibidilar va bir-birla iga birodarlarcha muomala qilishlari zarur. |
|||
|- |
|||
|| Uyghur || ھەممە ئادەم زاتىدىنلا ئەركىن، ئىززەت-ھۆرمەت ۋە ھوقۇقتا بابباراۋەر بولۇپ تۇغۇلغان. ئۇلار ئەقىلغە ۋە ۋىجدانغا ئىگە ھەمدە بىر-بىرىگە قېرىنداشلىق مۇناسىۋىتىگە خاس روھ بىلەن مۇئامىلە قىلىشى كېرەك. |
|||
|- |
|||
|| Tyva || Бүгү кижилер хостуг база мөзүзү болгаш эргелери дең кылдыр төрүттүнер. Оларга угаансарыыл болгаш арын-нүүр бердинген болур болгаш олар бот-боттарынга акы-дуңмалышкы хамаарылганы көргүзер ужурлуг. |
|||
|- |
|||
|| Karachay-Balkar || Бютеу адамла эркин болуб эмда сыйлары бла хакълары тенг болуб тууадыла. Алагъа акъыл бла намыс берилгенди эмда бир-бирлерине къарнашлыкъ халда къараргъа керекдиле. |
|||
|- |
|||
|| Altai || Ончо улус ак-јарыкка јайым ла теҥ-тай тап-эриктӱ туулат. Олор санааукаалу ла чек кӱӱн-тапту болуп бӱткен ле бой-бойын карындаш кирези кӧрӧр лӧ јӱрер учурлу. |
|||
|- |
|||
|| Khakas || Полған на кізі пос паза тиң тіріпче паза тиң постың синін пілінгенін паза тірелерініңде полча. Олардың сағынғаны паза арығ сағыс пар паза харындастар чіли тудынарға киректер. |
|||
|- |
|||
|| Shor || Парчын кижи, по чарыққа туғчадып, тең, пош туғча. Кижилер сағыштығ, ақтығ туғчалар, кижилерге пашқа кижилербе арғыштаныштарға керек. |
|||
|- |
|||
|| Sakha || Дьон барыта бэйэ суолтатыгар уонна быраабыгар тэҥ буолан төрүүллэр. Кинилэр бары өркөн өйдөөх, суобастаах буолан төрүүллэр, уонна бэйэ бэйэлэригэр тылга кииринигэс быһыылара доҕордоһуу тыыннаах буолуохтаах. |
|||
|- |
|||
| Crimean Tatar || Bütün insanlar ür, sayğı ve uquqlar itibarı ile musaviy doğalar. Aqıl ve vicdanğa saipler ve bir-birlerine qarşı ağa-qardaşlıq fikirnen areket etmelidirler. |
|||
|- |
|- |
||
|| Tuva || Бүгү кижилер хостуг база мөзүзү болгаш эргелери дең кылдыр төрүттүнер. Оларга угаансарыыл болгаш арын-нүүр бердинген болур болгаш олар бот-боттарынга акы-дуңмалышкы хамаарылганы көргүзер ужурлуг. |
|||
|} |
|} |
||
Line 605: | Line 799: | ||
==Official poem== |
==Official poem== |
||
* Kovayla bira içerim, ama sen bilmezsin. Yarın gelir misin? |
* (tur) Kovayla bira içerim, ama sen bilmezsin. Yarın gelir misin? |
||
* Vedrəyle pivə içirəm, ama sen bilməzsən. Yarın gələrmisən? |
* (aze) Vedrəyle pivə içirəm, ama sen bilməzsən. Yarın gələrmisən? |
||
* Чиләк белән сыра эчәм, әмма син белмисең. Иртәгә киләсеңме? |
* (tat) Чиләк белән сыра эчәм, әмма син белмисең. Иртәгә киләсеңме? |
||
* Шелекпен сыра ішемін, бірақ сен білмейсің. |
* (kaz) Шелекпен сыра ішемін, бірақ сен білмейсің. Ертең келесің бе? |
||
* Чака менен сыра ичем, бирок сен билбейсиң. Эртең келесиңби? |
* (kir) Чака менен сыра ичем, бирок сен билбейсиң. Эртең келесиңби? |
||
* Челек булан пиво ичемен амма сен билмейсен. |
<!--* (kum) Челек булан пиво ичемен, амма сен билмейсен. Тангала гелемисен? --> |
||
* Chelak bilan pivo ichaman lekin sen bilmaysan. Ertaga kelasanmi? |
* (uzb) Chelak bilan pivo ichaman lekin sen bilmaysan. Ertaga kelasanmi? |
||
* Shelek penen pivo ishemen, biraq sen bilmeysen'. Erten' kelesen'be? |
* (kaa) Shelek penen pivo ishemen, biraq sen bilmeysen'. Erten' kelesen'be? |
||
* (tlt) Кӧнӧкмынаң сыра ичип јадым, сен-оқ аның керегинде пилбей јазың. Таңда келерзиң бе? |
|||
==Footnotes== |
==Footnotes== |
||
<references/> |
<references/> |
||
==See also== |
|||
* [[Spellchecking for Turkic languages]] |
|||
==Bibliography== |
|||
* Sundetova, A., Tyers, F. M. and Forcada, M. L. (2015) "A free/open-source machine translation system for English to Kazakh". Proceedings of the 3rd Conference on Turkic Languages (TurkLang 2015). |
|||
* Tyers, F. M. and Washington, J. (2015) "Towards a free/open-source universal-dependency treebank for Kazakh". Proceedings of the 3rd Conference on Turkic Languages (TurkLang 2015). |
|||
* Washington, J. N., Salimzyanov, I., and Tyers, F. M. (2014) "Finite-state morphological transducers for three Kypchak languages". ''Proceedings of the 9th Conference on Language Resources and Evaluation, LREC2014 '' |
|||
* Salimzyanov, I., Washington, J. N., and Tyers, F. M. (2013) "A free/open-source Kazakh-Tatar machine translation system". ''Proceedings of MT Summit XIV '' |
|||
* Washington, J. N., Ipasov, M. and Tyers, F. M. (2012) "A finite-state morphological analyser for Kyrgyz". ''Proceedings of the 8th Conference on Language Resources and Evaluation, LREC2012 '' |
|||
* Tyers, F. M., Washington, J. N., Salimzyanov, I., and Batalov, R. (2012) "A prototype machine translation system for Tatar and Bashkir based on free/open-source components". ''Proceedings of the Turkic Languages Workshop'' at the ''Language Resources and Evaluation Conference, LREC2012 '' |
|||
[[Category:Turkic languages|*]] |
[[Category:Turkic languages|*]] |
Latest revision as of 15:24, 1 October 2021
The Turkic languages include Turkish, Azeri, Uzbek, Uyghur, Kazakh, Kyrgyz, Tatar, Chuvash, Turkmen, Bashkir, Sakha, Crimean Tatar and several dozen other languages. The languages are related with varying levels of mutual intelligibility. A team called Apertium Turkic aims to enhance MT coverage of these languages within Apertium.
The ultimate master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
Status[edit]
The ultimate goal is to have multi-purpose transducers and annotated corpora (i.e. treebanks) for a variety of Turkic languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
Transducers[edit]
- See also: Turkic lexicon and Languages
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
name | Language | native name | ISO 639 | formalism | state | stems | coverage | location | primary authors | |
---|---|---|---|---|---|---|---|---|---|---|
-1 | -3 | |||||||||
apertium-kaz
|
Kazakh | қазақ тілі | kk
|
kaz
|
HFST (lexc+twol) | production | 36,595 | ~94.5% | apertium-kaz (languages) | Ilnar, Jonathan, Fran, Aida, Beknazar, Nathan |
apertium-tat
|
Tatar | татар теле | tt
|
tat
|
HFST (lexc+twol) | production | 55,702 | ~91% | apertium-tat (languages) | Ilnar, Fran, Jonathan, Röstäm |
apertium-kir
|
Kyrgyz | кыргыз тили | ky
|
kir
|
HFST (lexc+twol) | working | 14,424 | ~90.4% | apertium-kir (languages) | Jonathan, Mirlan, Fran, Qantörö |
apertium-tyv
|
Tuvan | Тыва дыл | -
|
tyv
|
HFST (lexc+twol) | working | 11,695 | ~92.7% | apertium-tyv (languages) | Fran, Алдынай, Aziyana, Jonathan |
apertium-tur
|
Turkish | Türk dili | tr
|
tur
|
HFST (lexc+twol) | development | 17,221 | ~87.3% | apertium-tur (incubator) | Fran, Gianluca, Jonathan |
apertium-crh
|
Crimean Tatar | qırımtatar tili | -
|
crh
|
HFST (lexc+twol) | development | 11,757 | ~85.4% | apertium-crh (languages) | Fran, Jonathan |
apertium-chv |
Chuvash | чӑваш чӗлхи | cv |
chv |
HFST (lexc+twol) | development | 10,267 | ~85% | apertium-chv (languages) | Hèctor |
apertium-sah
|
Sakha | Саха тыла | -
|
sah
|
HFST (lexc+twol) | development | 11,531 | ~89.6% | apertium-sah (languages) | Sardana Ivanova, Fran, Jonathan, Christopher Straughn |
apertium-kum |
Kumyk | къумукъ тил | - |
kum |
HFST (lexc+twol) | development | 4,918 | ~90.2% | apertium-kum (languages) | Fran, Jonathan |
apertium-kaa
|
Karakalpak | Qaraqalpaq tili | -
|
kaa
|
HFST (lexc+twol) | development | 25,545 | ~86.1% | apertium-kaa (languages) | Beknazar, Fran, Jonathan |
apertium-uzb |
Uzbek | o'zbek tili | uz |
uzb |
HFST (lexc+twol) | development | 34,470 | ~82.9% | apertium-uzb (languages) | |
apertium-krc
|
Karachay-Balkar | Къарачай-Малкъар тил | -
|
krc
|
HFST (lexc+twol) | development | 7,895 | ~89.7% | apertium-krc (incubator) | Fran, Jonathan |
apertium-bak
|
Bashkir | башҡорт теле | ba
|
bak
|
HFST (lexc+twol) | development | 2,827 | ~66% | apertium-bak (languages) | Fran, Jonathan, Ilnar, Milli |
apertium-nog
|
Nogay | Ногай тили | -
|
nog
|
HFST (lexc+twol) | development | 1,385 | ~81.4% | apertium-nog (languages) | Fran, Jonathan |
apertium-gag
|
Gagauz | Gagauz dili | -
|
gag
|
HFST (lexc+twol) | prototype | 3,143 | ~78% | apertium-gag (incubator) | Fran Sevilay |
apertium-tuk
|
Turkmen | Türkmençe | tk
|
tuk
|
HFST (lexc+twol) | development | 2,988 | ~70.7% | apertium-tuk (languages) | Fran |
apertium-uig
|
Uyghur | ئۇيغۇر تىلى | ug
|
uig
|
HFST (lexc+twol) | prototype | 17,585 | ~54.2% | apertium-uig (incubator) | Jonathan, Märdan, Fran |
apertium-alt
|
Altay | Алтай тили | - | alt
|
HFST (lexc+twol) | prototype | 284 | ~52.27% | apertium-alt (incubator) | Jonathan, D Tokmashev |
apertium-kjh
|
Khakas | Хакас тілі | -
|
kjh
|
HFST (lexc+twol) | prototype | 293 | ~39.3% | apertium-kjh (incubator) | Fran |
apertium-ota
|
Ottoman Turkish | لسان عثمانى | -
|
ota
|
HFST (lexc+twol) | prototype | 75 | ~10.8% | apertium-ota (incubator) | Fran |
apertium-aze
|
Azerbaijani | Azərbaycan dili | az
|
aze
|
HFST (lexc+twol) | prototype | 11,120 | apertium-aze (incubator) | Gianluca |
Annotated corpora[edit]
name | Language | native name | ISO 639 | disambiguated | dep-annotated | avg. length | location | primary authors | ||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
-2 | -3 | sent | tokens | sent | tokens | |||||||
apertium-kaz
|
Kazakh | қазақ тілі | kk
|
kaz
|
- | - | 403 | 5086 | apertium-kaz (languages) | Jonathan, Fran | ||
apertium-tyv
|
Tuvan | Тыва дыл | -
|
tyv
|
- | - | 115 | 639 | apertium-tyv (languages) | Jonathan, Fran | ||
apertium-crh
|
Crimean Tatar | qırımtatar tili | -
|
crh
|
- | - | 150 | 855 | 5.7 | apertium-crh (languages) | Fran | |
apertium-krc
|
Karachay-Balkar | -
|
krc
|
- | - | 17 | 116 | 6.8 | Fran | |||
apertium-uig
|
Uyghur | ئۇيغۇر تىلى | -
|
uig
|
123 | 951 | 27 | 191 | 7.1 | apertium-uig (incubator) | Fran |
Turkic languages by subgroup[edit]
- Oğuz: Turkish, Azeri, Turkmen, Gagauz, Trukhmen, Afshar, Qashqai, Bojnur, etc.
- Qarluq: Uzbek, Uyghur
- Qıpçaq:
- West: Kumyk, Karachay-Balkar, Crimean Tatar, Karaim
- North: Tatar, Bashqort
- South (trad. East): Kazakh, Karakalpak, Nogay
- East: Kyrgyz
- Altay: South Altay (, Kyrgyz)
- Yeniseian: Khakas, Shor, Chulym, Baraba Tatar, North Altay
- Sayan: Tuvan, Tofa, Tozhu, Dukha, Soyot
- Lena: Sakha, Dolgan
- Arğu: Halaj
- Oğur: Chuvash
Pairs[edit]
Some Turkic languages that are particularly similar to one another (and hence have varying degrees of mutual intelligibility) include those in the following list:
- Turkish, Azerbaycani, (Turkmen)
- Qazaq, Qaraqalpaq, Noğay, (Qırğız)
- Kumyk, Karachay-Balkar
- Tatar, Bashqort
- Uzbek, Uyğur
- Shor, Khakas(, Altay)
- Sakha, Dolgan
- Tuvan, Tofa
Chuvash is very distant from other Turkic languages and is not even partially mutually intelligible with any of them.
Table of existing pairs[edit]
- See also: Turkic-Turkic translator
Text in italics denotes prototype language pairs in the incubator. Regular text denotes a developing language pair in nursery, while text in bold denotes a stable well-working language pair in trunk, and text in bold and italics denotes a pair in staging. Bidix stems as counted with dixcounter are displayed below.
tur | aze | tuk | uzb | kir | kaz | tat | bak | chv | nog | kaa | kum | uig | krc | crh | gag | sah | tyv | kjh | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
tur | - | tur-aze 8,194 |
tuk-tur 3,387 |
tur-uzb 13,086 |
tur-kir 7,123 |
kaz-tur 7,526 |
tur-tat 4,268 |
chv-tur 31,930 |
uig-tur 10,159 |
crh-tur 7,106 |
|||||||||
aze | tur-aze 8,194 |
- | |||||||||||||||||
tuk | tuk-tur 3,387 |
- | |||||||||||||||||
uzb | tur-uzb 13,086 |
- | kir-uzb 268 |
uzb-kaa 24,114 |
|||||||||||||||
kir | tur-kir 7,123 |
kir-uzb 268 |
- | kaz-kir 8,174 |
tat-kir |
||||||||||||||
kaz | kaz-tur 7,526 |
kaz-kir 8,174 |
- | kaz-tat 9,956 |
nog-kaz 9 |
kaz-kaa 5,408 |
kaz-kum 561 |
kaz-uig 2,728 |
kaz-sah 2,872 |
kaz-tyv 124 |
|||||||||
tat | tur-tat 4,268 |
tat-kir |
kaz-tat 9,956 |
- | tat-bak 57,710 |
chv-tat 29,456 |
|||||||||||||
bak | tat-bak 57,710 |
- | |||||||||||||||||
chv | chv-tur 31,930 |
chv-tat 29,456 |
- | ||||||||||||||||
nog | nog-kaz 9 |
- | |||||||||||||||||
kaa | uzb-kaa 24,114 |
kaz-kaa 5,408 |
- | ||||||||||||||||
kum | kaz-kum 561 |
- | |||||||||||||||||
uig | uig-tur 10,159 |
kaz-uig 2,728 |
- | ||||||||||||||||
krc | - | ||||||||||||||||||
crh | crh-tur 7,106 |
- | |||||||||||||||||
gag | - | ||||||||||||||||||
sah | kaz-sah 2,872 |
- | |||||||||||||||||
tyv | kaz-tyv 124 |
- | |||||||||||||||||
kjh | - | ||||||||||||||||||
eng | tr-en 171 |
eng-kir 465 |
eng-kaz 32,994 |
tat-eng 14,985 |
sah-eng |
||||||||||||||
epo | eo-tr 1,500 |
||||||||||||||||||
fin | tur-fin 21 |
||||||||||||||||||
khk | khk-kaz 134 |
||||||||||||||||||
rus | kaz-rus 29,572 |
tat-rus 6,003 |
cv-ru 75 |
Roadmap[edit]
Stable release of apertium-kazStable release of apertium-tatStable release of apertium-kaz-tat- Rework apertium-kir to match new standards
- Bring apertium-bak up to date (based on apertium-tat)
- Expand apertium-tat-bak
- Beta release of apertium-kaz-kir
- Beta release of apertium-tur-kir
- Expand apertium-tuk
- Expand apertium-chv
- Basic transducers for:
Qaraqalpaq (based onTatarKazakh, probably, no?)UzbekUyghurNogayKumyk- Khakas
TuvanSakha- Shor
Crimean Tatar
Getting involved[edit]
We have a work plan for developing Turkic-Turkic translators and are working on a how-to for building a Turkic lexicon. Please come talk to us on IRC or contact us on the apertium-turkic mailing list.
Samples[edit]
Article 1 of the Universal Declaration of Human Rights:
All human beings are born free and equal in dignity and rights. They are endowed with reason and conscience and should act towards one another in a spirit of brotherhood.
Language | Text |
---|---|
Kazakh | Барлық адамдар тумысынан азат және қадір‐қасиеті мен кұқықтары тең болып дүниеге келеді. Адамдарға ақыл‐парасат, ар‐ождан берілген, сондықтан олар бір‐бірімен туыстық, бауырмалдық қарым‐қатынас жасаулары тиіс. |
Tatar | Барлык кешеләр дә азат һәм үз абруйлары һәм хокуклары ягыннан тиң булып туалар. Аларга акыл һәм вөҗдан бирелгән һәм бер-берсенә карата туганнарча мөнәсәбәттә булырга тиешләр. |
Kyrgyz | Бардык адамдар өз беделинде жана укуктарында эркин жана тең укуктуу болуп жаралат. Алардын аң‐сезими менен абийири бар жана бири‐бирине бир туугандык мамилекылууга тийиш. |
Turkish | Bütün insanlar hür, haysiyet ve haklar bakımından eşit doğarlar. Akıl ve vicdana sahiptirler ve birbirlerine karşı kardeşlik zihniyeti ile hareket etmelidirler. |
Azerbaijani | Bütün insanlar ləyaqət və hüquqlarına görə azad və bərabər doğulurlar. Onların şüurları və vicdanları var və bir-birlərinə münasibətdə qardaşlıq ruhunda davranmalıdırlar. |
Gagauz | İnsannar hepsi duuêrlar serbest hem birtakım kendi kıymetindä hem haklarında. Onnara verilmiş akıl hem üz da läazım biri-birinä davransınnar kardaşlık ruhuna uygun. |
Turkmen | Adamlaryň hemmesi azat dogulýarlar we öz mertebesi hem-de hukuklary boýunça ilkibaşdan deňdirler. Olara ozal-başdan aň, ynsap berlendir we biri-birine özara doganlyk ruhunda çemeleşmek olaryň ýaraşygydyr. |
Uzbek (Latin script) | Barcha odamlar erkin, qadr-qimmat ba huquqlarda tang bo'lib tug'iladilar. Ular aql va vijdon sohibidilar va bir-birla iga birodarlarcha muomala qilishlari zarur. |
Uyghur | ھەممە ئادەم زاتىدىنلا ئەركىن، ئىززەت-ھۆرمەت ۋە ھوقۇقتا بابباراۋەر بولۇپ تۇغۇلغان. ئۇلار ئەقىلغە ۋە ۋىجدانغا ئىگە ھەمدە بىر-بىرىگە قېرىنداشلىق مۇناسىۋىتىگە خاس روھ بىلەن مۇئامىلە قىلىشى كېرەك. |
Tyva | Бүгү кижилер хостуг база мөзүзү болгаш эргелери дең кылдыр төрүттүнер. Оларга угаансарыыл болгаш арын-нүүр бердинген болур болгаш олар бот-боттарынга акы-дуңмалышкы хамаарылганы көргүзер ужурлуг. |
Karachay-Balkar | Бютеу адамла эркин болуб эмда сыйлары бла хакълары тенг болуб тууадыла. Алагъа акъыл бла намыс берилгенди эмда бир-бирлерине къарнашлыкъ халда къараргъа керекдиле. |
Altai | Ончо улус ак-јарыкка јайым ла теҥ-тай тап-эриктӱ туулат. Олор санааукаалу ла чек кӱӱн-тапту болуп бӱткен ле бой-бойын карындаш кирези кӧрӧр лӧ јӱрер учурлу. |
Khakas | Полған на кізі пос паза тиң тіріпче паза тиң постың синін пілінгенін паза тірелерініңде полча. Олардың сағынғаны паза арығ сағыс пар паза харындастар чіли тудынарға киректер. |
Shor | Парчын кижи, по чарыққа туғчадып, тең, пош туғча. Кижилер сағыштығ, ақтығ туғчалар, кижилерге пашқа кижилербе арғыштаныштарға керек. |
Sakha | Дьон барыта бэйэ суолтатыгар уонна быраабыгар тэҥ буолан төрүүллэр. Кинилэр бары өркөн өйдөөх, суобастаах буолан төрүүллэр, уонна бэйэ бэйэлэригэр тылга кииринигэс быһыылара доҕордоһуу тыыннаах буолуохтаах. |
Crimean Tatar | Bütün insanlar ür, sayğı ve uquqlar itibarı ile musaviy doğalar. Aqıl ve vicdanğa saipler ve bir-birlerine qarşı ağa-qardaşlıq fikirnen areket etmelidirler. |
Vulnerability[edit]
This table summarizes the vulnerability of various Turkic languages. Vulnerability data is derived from the ‘Atlas of the World’s Languages in Danger, © UNESCO, http://www.unesco.org/culture/languages-atlas’ and Ethnologue.
Language | ISO639-3 | Location | Speakers | Status | |
---|---|---|---|---|---|
Ethnologue | UNESCO | ||||
Chagatai | chg
|
Turkmenistan | 0 | 10 (Extinct) | - |
Salchuq | slq
|
Iran | 0 | 10 (Extinct) | - |
Chulym | clw
|
Russian Federation | 44 | 8b (Nearly extinct) | 4 (Critically endangered) |
Karaim | kdr
|
Lithuania & Ukraine | 56 | 8b (Nearly extinct) | 5 (Extinct) |
Tofa (Karagas) | kim
|
Russian Federation | 90 | 8b (Nearly extinct) | 4 (Critically endangered) |
Krimchak | jct
|
Ukraine | 200 | 8b (Nearly extinct) | - |
Ili Turki | ili
|
China | 120 | 8a (Moribund) | 3 (Severely endangered) |
Yugur (Western/Saryg) | ybe
|
China | 4,600 | 8a (Moribund) | 3 (Severely endangered) |
Balkan Gagauz Turkish | bgx
|
Turkey | 331,000 | 7 (Shifting) | - |
Dolgan | dlg
|
Russian Federation | 1,050 | 6b (Threatened) | 2 (Definitely endangered) |
Shor | cjs
|
Russian Federation | 2,840 | 6b (Threatened) | 3 (Severely endangered) |
Ainu | aib
|
China | 6,570 | 6b (Threatened) | - |
Altay, Northern | atv
|
Russian Federation | 57,400 | 6b (Threatened) | 3 (Severely endangered) |
Salar | slr
|
China | 70,000 | 6b (Threatened) | 1 (Vulnerable) |
Urum | uum
|
Georgia, Russian Federation, Ukraine | 192,700 | 6b (Threatened) | 2 (Definitely endangered) |
Khalaj | klj
|
Iran | 42,100 | 6a (Vigorous) | 1 (Vulnerable) |
Khorasani | kmz
|
Iran | 400,000 | 6a (Vigorous) | 1 (Vulnerable) |
Kashkay | qxq
|
Iran | 1,500,000 | 6a (Vigorous) | - |
Khakas | kjh
|
Russian Federation | 42,610 | 5 (Developing) | 5 (Extinct) |
Nogay | nog
|
Russian Federation | 87,410 | 5 (Developing) | 2 (Definitely endangered) |
Gagauz | gag
|
Moldova | 173,920 | 5 (Developing) | - |
Karakalpak | kaa
|
Uzbekistan | 410,410 | 5 (Developing) | - |
Kumyk | kum
|
Russian Federation | 426,550 | 5 (Developing) | 1 (Vulnerable) |
Tuva | tyv
|
China, Mongolia, Russian Federation | 283,400 | 4 (Educational) | 1 (Vulnerable) |
Karachay-Balkar | krc
|
Russian Federation | 310,730 | 4 (Educational) | 1 (Vulnerable) |
Crimean Tatar | crh
|
Ukraine | 475,540 | 4 (Educational) | - |
Chuvash | chv
|
Russian Federation | 1,077,420 | 4 (Educational) | 1 (Vulnerable) |
Bashkort | bak
|
Russian Federation | 1,221,340 | 4 (Educational) | 1 (Vulnerable) |
Uzbek, Southern | uzs
|
Afghanistan | 2,961,980 | 3 (Wider communication) | - |
Azerbaijani, Southern | azb
|
Iran | 16,913,280 | 3 (Wider communication) | - |
Altay, Southern | alt
|
Russian Federation | 57,400 | 2 (Provincial) | 2 (Definitely endangered) |
Yakut | sah
|
Russian Federation | 450,000 | 2 (Provincial) | 1 (Vulnerable) |
Tatar | tat
|
Russian Federation | 5,407,550 | 2 (Provincial) | 2 (Definitely endangered) |
Uyghur | uig
|
China | 8,791,610 | 2 (Provincial) | - |
Kyrgyz | kir
|
Kyrgyzstan | 2,941,930 | 1 (National) | - |
Azerbaijani, Northern | azj
|
Azerbaijan | 7,324,270 | 1 (National) | - |
Turkmen | tuk
|
Turkmenistan | 7,560,560 | 1 (National) | - |
Kazakh | kaz
|
Kazakhstan | 8,077,770 | 1 (National) | - |
Uzbek, Northern | uzn
|
Uzbekistan | 18,968,250 | 1 (National) | - |
Turkish | tur
|
Turkey | 50,733,420 | 1 (National) | - |
Official poem[edit]
- (tur) Kovayla bira içerim, ama sen bilmezsin. Yarın gelir misin?
- (aze) Vedrəyle pivə içirəm, ama sen bilməzsən. Yarın gələrmisən?
- (tat) Чиләк белән сыра эчәм, әмма син белмисең. Иртәгә киләсеңме?
- (kaz) Шелекпен сыра ішемін, бірақ сен білмейсің. Ертең келесің бе?
- (kir) Чака менен сыра ичем, бирок сен билбейсиң. Эртең келесиңби?
- (uzb) Chelak bilan pivo ichaman lekin sen bilmaysan. Ertaga kelasanmi?
- (kaa) Shelek penen pivo ishemen, biraq sen bilmeysen'. Erten' kelesen'be?
- (tlt) Кӧнӧкмынаң сыра ичип јадым, сен-оқ аның керегинде пилбей јазың. Таңда келерзиң бе?
Footnotes[edit]
See also[edit]
Bibliography[edit]
- Sundetova, A., Tyers, F. M. and Forcada, M. L. (2015) "A free/open-source machine translation system for English to Kazakh". Proceedings of the 3rd Conference on Turkic Languages (TurkLang 2015).
- Tyers, F. M. and Washington, J. (2015) "Towards a free/open-source universal-dependency treebank for Kazakh". Proceedings of the 3rd Conference on Turkic Languages (TurkLang 2015).
- Washington, J. N., Salimzyanov, I., and Tyers, F. M. (2014) "Finite-state morphological transducers for three Kypchak languages". Proceedings of the 9th Conference on Language Resources and Evaluation, LREC2014
- Salimzyanov, I., Washington, J. N., and Tyers, F. M. (2013) "A free/open-source Kazakh-Tatar machine translation system". Proceedings of MT Summit XIV
- Washington, J. N., Ipasov, M. and Tyers, F. M. (2012) "A finite-state morphological analyser for Kyrgyz". Proceedings of the 8th Conference on Language Resources and Evaluation, LREC2012
- Tyers, F. M., Washington, J. N., Salimzyanov, I., and Batalov, R. (2012) "A prototype machine translation system for Tatar and Bashkir based on free/open-source components". Proceedings of the Turkic Languages Workshop at the Language Resources and Evaluation Conference, LREC2012