Difference between revisions of "Languages of the Volga-Kama region"

From Apertium
Jump to navigation Jump to search
 
(24 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{TOCD}}
{{TOCD}}
The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]).
The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]).

The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

==Status==
The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

===Transducers===
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".

{| class="wikitable sortable"
|-
!rowspan=2| name
!rowspan=2| Language
!colspan=2 class="unsortable"| ISO 639
!rowspan=2| formalism
!rowspan=2| state
!rowspan=2| stems
!rowspan=2| coverage
!rowspan=2| location
!rowspan=2 class="unsortable"| primary authors
|-class="sortbottom"
! -2
! -3
|-
| <code>[[apertium-myv]]</code>
|| [[Erzya]]
|align="center"|<code>&ndash;</code>
|| <code>myv</code>
|| [[HFST|HFST (lexc+twol)]]
|| development
|align="right"| {{#lst:Apertium-myv-fin/stats|myv_stems}}
|align="center"|
|| [[apertium-myv-fin]]&nbsp;([[incubator]])
|| [[User:Francis_Tyers|Fran]], Jack Rueter
|-
|| <code>[[apertium-tat]]</code>
|| [[Tatar]]
|| <code>tt</code>
|| <code>tat</code>
|| [[HFST|HFST (lexc+twol)]]
|| {{#lst:Apertium-tat/stats|state}}
|align="right"| {{#lst:Apertium-tat/stats|stems}}
|align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
|| {{#lst:Apertium-tat/stats|location}}
|| {{#lst:Apertium-tat/stats|authors}}
|-
| <code>[[apertium-chv]]</code>
|| [[Chuvash]]
|| <code>cv</code>
|| <code>chv</code>
|| [[HFST|HFST (lexc+twol)]]
|| development
|align="right"| {{:apertium-chv/stems}}
|align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]]
|| [[apertium-chv]]&nbsp;([[languages]])
|| [[User:Hectoralos|Hèctor]]
|-
|| <code>[[apertium-bak]]</code>
|| [[Bashkir]]
|| <code>ba</code>
|| <code>bak</code>
|| [[HFST|HFST (lexc+twol)]]
|| development
|align="right"| {{:apertium-bak/stems}}
|align="center"| [[apertium-bak#Current_State|~{{:apertium-bak/stats/average}}%]]
|| [[apertium-bak]]&nbsp;([[languages]])
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli
|-
| <code>[[apertium-mrj]]</code>
|| [[Hill Mari]]
|align="center"|<code>&ndash;</code>
|| <code>mrj</code>
|| [[HFST|HFST (lexc+twol)]]
|| development
|align="right"| {{#lst:Apertium-mrj-fin/stats|mrj_stems}}
|align="center"|
|| [[apertium-mrj-fin]] ([[incubator]])
|| [[User:Francis_Tyers|Fran]], kuprina, jackrueter
|-
| <code>[[apertium-udm]]</code>
|| [[Udmurt]]
|align="center"| <code>&ndash;</code>
|| <code>udm</code>
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|align="right"| {{#lst:Apertium-udm-rus/stats|udm_stems}}
|align="center"|
|| [[apertium-udm-rus]]&nbsp;([[nursery]])
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей
|-
| <code>[[apertium-kpv]]</code>
|| [[Komi-Zyrian]]
|align="center"|<code>&ndash;</code>
|| <code>kpv</code>
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|align="right"| {{#lst:Apertium-kpv-mhr/stats|kpv_stems}}
|align="center"|
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, Andrei Chemyshev
|-
| <code>[[apertium-mhr]]</code>
|| [[Meadow Mari]]
|align="center"|<code>&ndash;</code>
|| <code>mhr</code>
|| [[HFST|HFST (lexc+twol)]]
|| prototype
|align="right"| {{#lst:Apertium-kpv-mhr/stats|mhr_stems}}
|align="center"|
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
|| [[User:Francis_Tyers|Fran]], Fedina, Andrei Chemyshev
|}

=== Existing language pairs ===

Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk.

{| style="text-align: center;" class="wikitable dixtable"
|- style="background: #ececec"
! !! tat !! chv !! bak !! mrj !! udm !! mhr !! myv !! kpv
|-
| '''tat''' || - || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || || || ||
|-
| '''chv''' || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || - || || || || || ||
|-
| '''bak''' || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || - || || || || ||
|-
| '''mrj''' || || || || - || || || ||
|-
| '''udm''' || || || || || - || || ||
|-
| '''mhr''' || || || || || || - || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}}
|-
| '''myv''' || || || || || || || - ||
|-
| '''kpv''' || || || || || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}} || || -
|-
| || || || || || || || ||
|-
| '''fin''' || || || || ''[[Apertium-mrj-fin|mrj-fin]]''<br>{{#lst:Apertium-mrj-fin/stats|mrj-fin_stems}} || ''[[Apertium-fin-udm|fin-udm]]''<br>{{#lst:Apertium-fin-udm/stats|fin-udm_stems}} || || ''[[Apertium-myv-fin|myv-fin]]''<br>{{#lst:Apertium-myv-fin/stats|myv-fin_stems}} || ''[[Apertium-kpv-fin|kpv-fin]]''<br>{{#lst:Apertium-kpv-fin/stats|kpv-fin_stems}}
|-
| '''kaz''' || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_stems}}''' || || || || || || ||
|-
| '''kir''' || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_stems}} || || || || || || ||
|-
| '''rus''' || [[Apertium-tat-rus|tat-rus]]<br>{{#lst:Apertium-tat-rus/stats|tat-rus_stems}} || ''[[Apertium-cv-ru|cv-ru]]''<br>{{#lst:Apertium-cv-ru/stats|cv-ru_stems}} || || || [[Apertium-udm-rus|udm-rus]]<br>{{#lst:Apertium-udm-rus/stats|udm-rus_stems}} || || ||
|-
| '''tur''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_stems}} || ''[[Apertium-cv-tr|cv-tr]]''<br>{{#lst:Apertium-cv-tr/stats|cv-tr_stems}} || || || || || ||
|}


== The languages ==
== The languages ==

The following table shows information about Volga-Kama varieties and information about apertium projects related to the languages.
=== Volga-Kama languages by subgroup ===
* [[Turkic languages|Turkic]]
** North Qıpçaq: [[Tatar]], [[Bashqort]]
** Oğur: [[Chuvash]]

* [[Uralic languages|Uralic]] → Finno-Ugric → Finno-Permic
** Permic: [[Komi]] (Komi-Zyrian, Komi-Permyak, Komi-Yazva), [[Udmurt]]
** Finno-Volgaic
*** [[Mari]]: [[Meadow Mari|Meadow Mari (Eastern)]], [[Hill Mari|Hill Mari (Western)]]
*** [[Mordvin]]: [[Erzya]], [[Moksha]]

=== Volga-Kama language vulnerability ===

The following table shows information about Volga-Kama varieties.


{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
! language !! iso !! num speakers !! UNESCO classification !! Apertium support
! language !! iso !! num speakers !! UNESCO classification
|-
|-
| Tatar || <code>tat</code> || 6500K || 0. none || incubator/apertium-tr-tt/
| Tatar || <code>tat</code> || 6500K || 0. none
incubator/apertium-tt-kk/
incubator/apertium-tt-ky/
incubator/apertium-tt-ru/
incubator/apertium-cv-tt/
nursery/apertium-tt-ba/
|-
|-
| Bashqort || <code>bak</code> || 1379K || 1. vulnerable || nursery/apertium-tt-ba/
| Bashqort || <code>bak</code> || 1379K || 1. vulnerable
|-
|-
| Chuvash || <code>chv</code> || 1325K || 1. vulnerable || incubator/apertium-cv-ru/
| Chuvash || <code>chv</code> || 1325K || 1. vulnerable
incubator/apertium-cv-tr/
incubator/apertium-cv-tt/
|-
|-
| Udmurt || <code>udm</code> || 0464K || 2. definitely endangered || incubator/apertium-fin-udm/
| Udmurt || <code>udm</code> || 0464K || 2. definitely endangered
nursery/apertium-udm-rus/
|-
|-
| Mari - Eastern || <code>mhr</code> || 0414K || 2. definitely endangered || incubator/apertium-kpv-mhr/
| Mari - Eastern || <code>mhr</code> || 0414K || 2. definitely endangered
|-
|-
| Mordvin - Erzya || <code>myv</code> || 0400K || 2. definitely endangered ||
| Mordvin - Erzya || <code>myv</code> || 0400K || 2. definitely endangered
|-
|-
| Komi - Zyryan || <code>kpv</code> || 0217K || 2. definitely endangered || incubator/apertium-kpv-mhr/
| Komi - Zyryan || <code>kpv</code> || 0217K || 2. definitely endangered
|-
|-
| Mordvin&nbsp;-&nbsp;Moksha || <code>mdf</code> || 0200K || 2. definitely endangered ||
| Mordvin&nbsp;-&nbsp;Moksha || <code>mdf</code> || 0200K || 2. definitely endangered
|-
|-
| Komi - Permyak || <code>koi</code> || 0094K || 2. definitely endangered ||
| Komi - Permyak || <code>koi</code> || 0094K || 2. definitely endangered
|-
|-
| Mari - Western || <code>mrj</code> || 0037K || 3. severely endangered ||
| Mari - Western || <code>mrj</code> || 0037K || 3. severely endangered
|-
|-
| Komi - Yazva || <code>koi</code> || 0000K || 3. severely endangered ||
| Komi - Yazva || <code>koi</code> || 0000K || 3. severely endangered
|}
|}


Line 46: Line 201:
== Existing computational resources ==
== Existing computational resources ==
=== Corpora and corpora projects ===
=== Corpora and corpora projects ===
* [http://www.hum.utu.fi/oppiaineet/volga/en/materials/ University of Turku - Research Unit for Volgaic Languages]
=== Spell-checkers ===
=== Spell-checkers ===
=== Text-to-speech and speech-to-text systems ===
=== Text-to-speech and speech-to-text systems ===
Line 53: Line 209:
** Chuvash
** Chuvash
** ...?
** ...?
=== Morphological Transducers ===
* [http://www.doria.fi/handle/10024/45006 Mari]


== Scholarship ==
== Scholarship ==

[[Category:Languages of the former Soviet Union]]
[[Category:Languages of the Volga-Kama region]]
[[Category:Turkic languages]]
[[Category:Uralic languages]]

Latest revision as of 23:25, 22 December 2014

The languages of the Volga-Kama region include several Turkic and Uralic languages spoken in the Volga-Kama region (along the Volga and Kama rivers) in Russia. These include [varieties of] Tatar, Bashqort, Chuvash, Mari, Komi, Mordvin, and Udmurt (and linguistically, to some extent, Russian).

The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

Status[edit]

The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

Transducers[edit]

Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".

name Language ISO 639 formalism state stems coverage location primary authors
-2 -3
apertium-myv Erzya – myv HFST (lexc+twol) development 74,977 apertium-myv-fin (incubator) Fran, Jack Rueter
apertium-tat Tatar tt tat HFST (lexc+twol) production 55,702 ~91% apertium-tat (languages) Ilnar, Fran, Jonathan, Röstäm
apertium-chv Chuvash cv chv HFST (lexc+twol) development 8,579 ~85% apertium-chv (languages) Hèctor
apertium-bak Bashkir ba bak HFST (lexc+twol) development 2,827 ~66% apertium-bak (languages) Fran, Jonathan, Ilnar, Milli
apertium-mrj Hill Mari – mrj HFST (lexc+twol) development 53,051 apertium-mrj-fin (incubator) Fran, kuprina, jackrueter
apertium-udm Udmurt – udm HFST (lexc+twol) prototype 196 apertium-udm-rus (nursery) Fran, Trond, Andrey, Лукерья, Алексей
apertium-kpv Komi-Zyrian – kpv HFST (lexc+twol) prototype 135 apertium-kpv-mhr (incubator) Fran, Trond, Fedina, Andrei Chemyshev
apertium-mhr Meadow Mari – mhr HFST (lexc+twol) prototype 117 apertium-kpv-mhr (incubator) Fran, Fedina, Andrei Chemyshev

Existing language pairs[edit]

Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.

tat chv bak mrj udm mhr myv kpv
tat - chv-tat
198		 tat-bak
2,941
chv chv-tat
198		 -
bak tat-bak
2,941		 -
mrj -
udm -
mhr - kpv-mhr
127
myv -
kpv kpv-mhr
127		 -
fin mrj-fin
273		 fin-udm
93		 myv-fin
401		 kpv-fin
1
kaz 'kaz-tat
'
kir tat-kir
rus tat-rus
5,999		 cv-ru
75		 udm-rus
148
tur tur-tat
3,317		 cv-tr
100

The languages[edit]

Volga-Kama languages by subgroup[edit]

Volga-Kama language vulnerability[edit]

The following table shows information about Volga-Kama varieties.

language iso num speakers UNESCO classification
Tatar tat 6500K 0. none
Bashqort bak 1379K 1. vulnerable
Chuvash chv 1325K 1. vulnerable
Udmurt udm 0464K 2. definitely endangered
Mari - Eastern mhr 0414K 2. definitely endangered
Mordvin - Erzya myv 0400K 2. definitely endangered
Komi - Zyryan kpv 0217K 2. definitely endangered
Mordvin - Moksha mdf 0200K 2. definitely endangered
Komi - Permyak koi 0094K 2. definitely endangered
Mari - Western mrj 0037K 3. severely endangered
Komi - Yazva koi 0000K 3. severely endangered

Existing general resources[edit]

Grammars[edit]

Dictionaries[edit]

Existing computational resources[edit]

Corpora and corpora projects[edit]

Spell-checkers[edit]

Text-to-speech and speech-to-text systems[edit]

Keyboards[edit]

  • Xkb includes keyboards for the following languages:
    • Tatar
    • Chuvash
    • ...?

Morphological Transducers[edit]

Scholarship[edit]

Retrieved from "https://wiki.apertium.org/w/index.php?title=Languages_of_the_Volga-Kama_region&oldid=52167"