Difference between revisions of "Languages of the Volga-Kama region"

From Apertium
Jump to navigation Jump to search
 
(13 intermediate revisions by 3 users not shown)
Line 31: Line 31:
|| [[HFST|HFST (lexc+twol)]]
|| [[HFST|HFST (lexc+twol)]]
|| development
|| development
|align="right"| {{#lst:Apertium-myv-fin/stats|myv-stems}}
|align="right"| {{#lst:Apertium-myv-fin/stats|myv_stems}}
|align="center"|
|align="center"|
|| [[apertium-myv-fin]] ([[incubator]])
|| [[apertium-myv-fin]] ([[incubator]])
Line 41: Line 41:
|| <code>tat</code>
|| <code>tat</code>
|| [[HFST|HFST (lexc+twol)]]
|| [[HFST|HFST (lexc+twol)]]
|| {{#lst:Apertium-tat/stats|state}}
|| working
|align="right"| {{#lst:Apertium-tat/stats|stems}}
|align="right"| {{#lst:Apertium-tat/stats|stems}}
|align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
|align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
|| {{#lst:Apertium-tat/stats|location}}
|| [[apertium-tat]] ([[languages]])
|| {{#lst:Apertium-tat/stats|authors}}
|| [[User:Ilnar.salimzyan|Ilnar]], [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], Milli
|-
|-
| <code>[[apertium-chv]]</code>
| <code>[[apertium-chv]]</code>
Line 68: Line 68:
|| [[apertium-bak]]&nbsp;([[languages]])
|| [[apertium-bak]]&nbsp;([[languages]])
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli
|-
| <code>[[apertium-mrj]]</code>
|| [[Hill Mari]]
|align="center"|<code>&ndash;</code>
|| <code>mrj</code>
|| [[HFST|HFST (lexc+twol)]]
|| development
|align="right"| {{#lst:Apertium-mrj-fin/stats|mrj_stems}}
|align="center"|
|| [[apertium-mrj-fin]] ([[incubator]])
|| [[User:Francis_Tyers|Fran]], kuprina, jackrueter
|-
|-
| <code>[[apertium-udm]]</code>
| <code>[[apertium-udm]]</code>
Line 75: Line 86:
|| [[HFST|HFST (lexc+twol)]]
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|| prototype
|align="right"| {{#lst:Apertium-udm-rus/stats|udm-stems}}
|align="right"| {{#lst:Apertium-udm-rus/stats|udm_stems}}
|align="center"|
|align="center"|
|| [[apertium-fin-udm]]&nbsp;([[incubator]]) <br> [[apertium-udm-rus]]&nbsp;([[nursery]])
|| [[apertium-udm-rus]]&nbsp;([[nursery]])
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей
|-
|-
Line 86: Line 97:
|| [[HFST|HFST (lexc+twol)]]
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|| prototype
|align="right"| {{#lst:Apertium-kpv-mhr/stats|kpv-stems}}
|align="right"| {{#lst:Apertium-kpv-mhr/stats|kpv_stems}}
|align="center"|
|align="center"|
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]]) <br> [[apertium-kpv-fin]]&nbsp;([[incubator]])
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, Andrei Chemyshev
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, Andrei Chemyshev
|-
|-
Line 97: Line 108:
|| [[HFST|HFST (lexc+twol)]]
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|| prototype
|align="right"| {{#lst:Apertium-kpv-mhr/stats|mhr-stems}}
|align="right"| {{#lst:Apertium-kpv-mhr/stats|mhr_stems}}
|align="center"|
|align="center"|
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
Line 104: Line 115:


=== Existing language pairs ===
=== Existing language pairs ===

==== Volga-Kama&ndash;Volga-Kama pairs ====


Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk.
Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk.


{| style="text-align: center;" class="wikitable"
{| style="text-align: center;" class="wikitable dixtable"
|- style="background: #ececec"
|- style="background: #ececec"
! !! tat !! chv !! bak !! udm !! mhr !! myv !! kpv
! !! tat !! chv !! bak !! mrj !! udm !! mhr !! myv !! kpv
|-
| '''tat''' || - || ''[[apertium-cv-tt|cv-tt]]'' || ''[[apertium-tat-bak|tat-bak]]'' || || || ||
|-
| '''chv''' || ''[[apertium-cv-tt|cv-tt]]'' || - || || || || ||
|-
| '''bak''' || ''[[apertium-tat-bak|tat-bak]]'' || || - || || || ||
|-
| '''udm''' || || || || - || || ||
|-
| '''mhr''' || || || || || - || || ''[[apertium-kpv-mhr|kpv-mhr]]''
|-
| '''myv''' || || || || || || - ||
|-
| '''kpv''' || || || || || ''[[apertium-kpv-mhr|kpv-mhr]]'' || || -
|}

==== Pairs with non&ndash;Volga-Kama languages ====
{| style="text-align: center;" class="wikitable"
|- style="background: #ececec"
! !! tat !! chv !! bak !! udm !! mhr !! myv !!kpv
|-
| '''ru''' || ''[[apertium-tt-ru|tt-ru]]'' || ''[[apertium-cv-ru|cv-ru]]'' || || ''[[apertium-udm-rus|udm-rus]]'' || || ||
|-
| '''ky''' || ''[[apertium-tt-ky|tt-ky]]'' || || || || || ||
|-
| '''tr''' || || ''[[apertium-cv-tr|cv-tr]]'' || || || || ||
|-
| '''fin''' || || || || ''[[apertium-fin-udm|fin-udm]]'' || || ''[[apertium-myv-fin|myv-fin]]'' || ''[[apertium-kpv-fin|kpv-fin]]''
|}

==== Table of dix progress ====
{| style="text-align: center;" class="wikitable"
|- style="background: #ececec"
! !! tat !! chv !! bak !! udm !! mhr !! myv !! kpv
|-
| '''tat''' || - || {{#lst:Apertium-cv-tt/stats|cv-tt-stems}} || {{#lst:Apertium-tat-bak/stats|tat-bak-stems}} || || || ||
|-
| '''chv''' || {{#lst:Apertium-cv-tt/stats|cv-tt-stems}} || - || || || || ||
|-
| '''bak''' || {{#lst:Apertium-tat-bak/stats|tat-bak-stems}} || || - || || || ||
|-
| '''udm''' || || || || - || || ||
|-
| '''mhr''' || || || || || - || || {{#lst:Apertium-kpv-mhr/stats|kpv-mhr-stems}}
|-
| '''myv''' || || || || || || - ||
|-
| '''kpv''' || || || || || {{#lst:Apertium-kpv-mhr/stats|kpv-mhr-stems}} || || -
|-
| || || || || || || ||
|-
| '''ru''' || {{#lst:Apertium-tt-ru/stats|tt-ru-stems}} || {{#lst:Apertium-cv-ru/stats|cv-ru-stems}} || || {{#lst:Apertium-udm-rus/stats|udm-rus-stems}} || || ||
|-
| '''ky''' || {{#lst:Apertium-tt-ky/stats|tt-ky-stems}} || || || || || ||
|-
| '''tr''' || || {{#lst:Apertium-cv-tr/stats|stems}} || || || || ||
|-
| '''fin''' || || || || {{#lst:Apertium-fin-udm/stats|fin-udm-stems}} || || {{#lst:Apertium-myv-fin/stats|myv-fin-stems}} || {{#lst:Apertium-kpv-fin/stats|kpv-fin-stems}}
|-
| '''kaz''' || {{#lst:Apertium-kaz-tat/stats|kaz-tat-stems}} || || || || || ||
|}

{| style="text-align: center;" class="wikitable"
|- style="background: #ececec"
! !! bul !! mkd !! ron !! rup !! sqi !! ell !! hbs !! slv !! tur
|-
| '''bul''' || - || '''[[Apertium-mk-bg|mk-bg]]: '''8,783 || || || || ''[[Apertium-bg-el|bg-el]]: ''638 || || ||
|-
| '''mkd''' || '''[[Apertium-mk-bg|mk-bg]]: '''8,783 || - || || || ''[[Apertium-mk-sq|mk-sq]]: ''0 || || || ''[[Apertium-mk-sl|mk-sl]]: ''25,579 ||
|-
| '''ron''' || || || - || ''[[Apertium-ron-rup|ron-rup]]: ''402 || || || || ||
|-
| '''rup''' || || || ''[[Apertium-rup-ron|rup-ron]]: ''402 || - || || || || ||
|-
| '''sqi''' || || ''[[Apertium-sq-mk|sq-mk]]: ''0 || || || - || || || ||
|-
|-
| '''ell''' || ''[[Apertium-bg-el|bg-el]]: ''638 || || || || || - || || ||
| '''tat''' || - || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || || || ||
|-
|-
| '''hbs''' || || || || || || || - || '''[[Apertium-slv-hbs|slv-hbs]]: '''22,863 ||
| '''chv''' || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || - || || || || || ||
|-
|-
| '''slv''' || || ''[[Apertium-mk-sl|mk-sl]]: ''25,579 || || || || || '''[[Apertium-hbs-slv|hbs-slv]]: '''22,863 || - ||
| '''bak''' || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || - || || || || ||
|-
|-
| '''tur''' || || || || || || || || || -
| '''mrj''' || || || || - || || || ||
|-
|-
| || || || || || || || || ||
| '''udm''' || || || || || - || || ||
|-
|-
| '''tat''' || || || || || || || || || ''[[Apertium-tat-tur|tat-tur]]: ''213
| '''mhr''' || || || || || || - || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}}
|-
|-
| '''rus''' || ''[[Apertium-bg-ru|bg-ru]]: ''3,292 || || || || || || ''[[Apertium-rus-hbs|rus-hbs]]: ''5,008 || ||
| '''myv''' || || || || || || || - ||
|-
|-
| '''ita''' || || || ''[[Apertium-ro-it|ro-it]]: ''10,093 || || || || || ''[[Apertium-it-sl|it-sl]]: ''1,485 ||
| '''kpv''' || || || || || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}} || || -
|-
|-
| '''spa''' || || || || || || || || ''[[Apertium-spa-slv|spa-slv]]: ''0 ||
| || || || || || || || ||
|-
|-
| '''eng''' || ''[[Apertium-bg-en|bg-en]]: ''10,242 || '''[[Apertium-mk-en|mk-en]]: '''33,350 || || || || ''[[Apertium-ell-eng|ell-eng]]: ''0 || ''[[Apertium-hbs-eng|hbs-eng]]: ''93 || || ''[[Apertium-tr-en|tr-en]]: ''171
| '''fin''' || || || || ''[[Apertium-mrj-fin|mrj-fin]]''<br>{{#lst:Apertium-mrj-fin/stats|mrj-fin_stems}} || ''[[Apertium-fin-udm|fin-udm]]''<br>{{#lst:Apertium-fin-udm/stats|fin-udm_stems}} || || ''[[Apertium-myv-fin|myv-fin]]''<br>{{#lst:Apertium-myv-fin/stats|myv-fin_stems}} || ''[[Apertium-kpv-fin|kpv-fin]]''<br>{{#lst:Apertium-kpv-fin/stats|kpv-fin_stems}}
|-
|-
| '''aze''' || || || || || || || || || [[Apertium-tur-aze|tur-aze]]: 8,194
| '''kaz''' || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_stems}}''' || || || || || || ||
|-
|-
| '''pol''' || || || || || || || || ''[[Apertium-pol-slv|pol-slv]]: ''354 ||
| '''kir''' || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_stems}} || || || || || || ||
|-
|-
| '''rus''' || [[Apertium-tat-rus|tat-rus]]<br>{{#lst:Apertium-tat-rus/stats|tat-rus_stems}} || ''[[Apertium-cv-ru|cv-ru]]''<br>{{#lst:Apertium-cv-ru/stats|cv-ru_stems}} || || || [[Apertium-udm-rus|udm-rus]]<br>{{#lst:Apertium-udm-rus/stats|udm-rus_stems}} || || ||
| '''kir''' || || || || || || || || || ''[[Apertium-kir-tur|kir-tur]]: ''7,161
|-
|-
| '''tur''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_stems}} || ''[[Apertium-cv-tr|cv-tr]]''<br>{{#lst:Apertium-cv-tr/stats|cv-tr_stems}} || || || || || ||
| '''uzb''' || || || || || || || || || ''[[Apertium-tur-uzb|tur-uzb]]: ''2,416
|}
|}


Line 232: Line 166:
=== Volga-Kama language vulnerability ===
=== Volga-Kama language vulnerability ===


The following table shows information about Volga-Kama varieties and information about apertium projects related to the languages.
The following table shows information about Volga-Kama varieties.


{|class="wikitable sortable"
{|class="wikitable sortable"

Latest revision as of 23:25, 22 December 2014

The languages of the Volga-Kama region include several Turkic and Uralic languages spoken in the Volga-Kama region (along the Volga and Kama rivers) in Russia. These include [varieties of] Tatar, Bashqort, Chuvash, Mari, Komi, Mordvin, and Udmurt (and linguistically, to some extent, Russian).

The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

Status[edit]

The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

Transducers[edit]

Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".

name Language ISO 639 formalism state stems coverage location primary authors
-2 -3
apertium-myv Erzya myv HFST (lexc+twol) development 74,977 apertium-myv-fin (incubator) Fran, Jack Rueter
apertium-tat Tatar tt tat HFST (lexc+twol) production 55,702 ~91% apertium-tat (languages) Ilnar, Fran, Jonathan, Röstäm
apertium-chv Chuvash cv chv HFST (lexc+twol) development 8,579 ~85% apertium-chv (languages) Hèctor
apertium-bak Bashkir ba bak HFST (lexc+twol) development 2,827 ~66% apertium-bak (languages) Fran, Jonathan, Ilnar, Milli
apertium-mrj Hill Mari mrj HFST (lexc+twol) development 53,051 apertium-mrj-fin (incubator) Fran, kuprina, jackrueter
apertium-udm Udmurt udm HFST (lexc+twol) prototype 196 apertium-udm-rus (nursery) Fran, Trond, Andrey, Лукерья, Алексей
apertium-kpv Komi-Zyrian kpv HFST (lexc+twol) prototype 135 apertium-kpv-mhr (incubator) Fran, Trond, Fedina, Andrei Chemyshev
apertium-mhr Meadow Mari mhr HFST (lexc+twol) prototype 117 apertium-kpv-mhr (incubator) Fran, Fedina, Andrei Chemyshev

Existing language pairs[edit]

Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.

tat chv bak mrj udm mhr myv kpv
tat - chv-tat
198
tat-bak
2,941
chv chv-tat
198
-
bak tat-bak
2,941
-
mrj -
udm -
mhr - kpv-mhr
127
myv -
kpv kpv-mhr
127
-
fin mrj-fin
273
fin-udm
93
myv-fin
401
kpv-fin
1
kaz 'kaz-tat
'
kir tat-kir
rus tat-rus
5,999
cv-ru
75
udm-rus
148
tur tur-tat
3,317
cv-tr
100

The languages[edit]

Volga-Kama languages by subgroup[edit]

Volga-Kama language vulnerability[edit]

The following table shows information about Volga-Kama varieties.

language iso num speakers UNESCO classification
Tatar tat 6500K 0. none
Bashqort bak 1379K 1. vulnerable
Chuvash chv 1325K 1. vulnerable
Udmurt udm 0464K 2. definitely endangered
Mari - Eastern mhr 0414K 2. definitely endangered
Mordvin - Erzya myv 0400K 2. definitely endangered
Komi - Zyryan kpv 0217K 2. definitely endangered
Mordvin - Moksha mdf 0200K 2. definitely endangered
Komi - Permyak koi 0094K 2. definitely endangered
Mari - Western mrj 0037K 3. severely endangered
Komi - Yazva koi 0000K 3. severely endangered

Existing general resources[edit]

Grammars[edit]

Dictionaries[edit]

Existing computational resources[edit]

Corpora and corpora projects[edit]

Spell-checkers[edit]

Text-to-speech and speech-to-text systems[edit]

Keyboards[edit]

  • Xkb includes keyboards for the following languages:
    • Tatar
    • Chuvash
    • ...?

Morphological Transducers[edit]

Scholarship[edit]