Difference between revisions of "Languages of the Volga-Kama region"

From Apertium
Jump to navigation Jump to search
m
 
(33 intermediate revisions by 4 users not shown)
Line 1: Line 1:
  +
{{TOCD}}
The languages of the Volga-Kama region include [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and to some extent [[Russian]]).
 
  +
The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]).
  +
  +
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
  +
  +
==Status==
  +
The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
  +
  +
===Transducers===
  +
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
  +
  +
{| class="wikitable sortable"
  +
|-
  +
!rowspan=2| name
  +
!rowspan=2| Language
  +
!colspan=2 class="unsortable"| ISO 639
  +
!rowspan=2| formalism
  +
!rowspan=2| state
  +
!rowspan=2| stems
  +
!rowspan=2| coverage
  +
!rowspan=2| location
  +
!rowspan=2 class="unsortable"| primary authors
  +
|-class="sortbottom"
  +
! -2
  +
! -3
  +
|-
  +
| <code>[[apertium-myv]]</code>
  +
|| [[Erzya]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>myv</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{#lst:Apertium-myv-fin/stats|myv_stems}}
  +
|align="center"|
  +
|| [[apertium-myv-fin]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], Jack Rueter
  +
|-
  +
|| <code>[[apertium-tat]]</code>
  +
|| [[Tatar]]
  +
|| <code>tt</code>
  +
|| <code>tat</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| {{#lst:Apertium-tat/stats|state}}
  +
|align="right"| {{#lst:Apertium-tat/stats|stems}}
  +
|align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
  +
|| {{#lst:Apertium-tat/stats|location}}
  +
|| {{#lst:Apertium-tat/stats|authors}}
  +
|-
  +
| <code>[[apertium-chv]]</code>
  +
|| [[Chuvash]]
  +
|| <code>cv</code>
  +
|| <code>chv</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{:apertium-chv/stems}}
  +
|align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]]
  +
|| [[apertium-chv]]&nbsp;([[languages]])
  +
|| [[User:Hectoralos|Hèctor]]
  +
|-
  +
|| <code>[[apertium-bak]]</code>
  +
|| [[Bashkir]]
  +
|| <code>ba</code>
  +
|| <code>bak</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{:apertium-bak/stems}}
  +
|align="center"| [[apertium-bak#Current_State|~{{:apertium-bak/stats/average}}%]]
  +
|| [[apertium-bak]]&nbsp;([[languages]])
  +
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli
  +
|-
  +
| <code>[[apertium-mrj]]</code>
  +
|| [[Hill Mari]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>mrj</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{#lst:Apertium-mrj-fin/stats|mrj_stems}}
  +
|align="center"|
  +
|| [[apertium-mrj-fin]] ([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], kuprina, jackrueter
  +
|-
  +
| <code>[[apertium-udm]]</code>
  +
|| [[Udmurt]]
  +
|align="center"| <code>&ndash;</code>
  +
|| <code>udm</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| prototype
  +
|align="right"| {{#lst:Apertium-udm-rus/stats|udm_stems}}
  +
|align="center"|
  +
|| [[apertium-udm-rus]]&nbsp;([[nursery]])
  +
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей
  +
|-
  +
| <code>[[apertium-kpv]]</code>
  +
|| [[Komi-Zyrian]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>kpv</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| prototype
  +
|align="right"| {{#lst:Apertium-kpv-mhr/stats|kpv_stems}}
  +
|align="center"|
  +
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, Andrei Chemyshev
  +
|-
  +
| <code>[[apertium-mhr]]</code>
  +
|| [[Meadow Mari]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>mhr</code>
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| prototype
  +
|align="right"| {{#lst:Apertium-kpv-mhr/stats|mhr_stems}}
  +
|align="center"|
  +
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], Fedina, Andrei Chemyshev
  +
|}
  +
  +
=== Existing language pairs ===
  +
  +
Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk.
  +
  +
{| style="text-align: center;" class="wikitable dixtable"
  +
|- style="background: #ececec"
  +
! !! tat !! chv !! bak !! mrj !! udm !! mhr !! myv !! kpv
  +
|-
  +
| '''tat''' || - || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || || || ||
  +
|-
  +
| '''chv''' || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || - || || || || || ||
  +
|-
  +
| '''bak''' || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || - || || || || ||
  +
|-
  +
| '''mrj''' || || || || - || || || ||
  +
|-
  +
| '''udm''' || || || || || - || || ||
  +
|-
  +
| '''mhr''' || || || || || || - || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}}
  +
|-
  +
| '''myv''' || || || || || || || - ||
  +
|-
  +
| '''kpv''' || || || || || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}} || || -
  +
|-
  +
| || || || || || || || ||
  +
|-
  +
| '''fin''' || || || || ''[[Apertium-mrj-fin|mrj-fin]]''<br>{{#lst:Apertium-mrj-fin/stats|mrj-fin_stems}} || ''[[Apertium-fin-udm|fin-udm]]''<br>{{#lst:Apertium-fin-udm/stats|fin-udm_stems}} || || ''[[Apertium-myv-fin|myv-fin]]''<br>{{#lst:Apertium-myv-fin/stats|myv-fin_stems}} || ''[[Apertium-kpv-fin|kpv-fin]]''<br>{{#lst:Apertium-kpv-fin/stats|kpv-fin_stems}}
  +
|-
  +
| '''kaz''' || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_stems}}''' || || || || || || ||
  +
|-
  +
| '''kir''' || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_stems}} || || || || || || ||
  +
|-
  +
| '''rus''' || [[Apertium-tat-rus|tat-rus]]<br>{{#lst:Apertium-tat-rus/stats|tat-rus_stems}} || ''[[Apertium-cv-ru|cv-ru]]''<br>{{#lst:Apertium-cv-ru/stats|cv-ru_stems}} || || || [[Apertium-udm-rus|udm-rus]]<br>{{#lst:Apertium-udm-rus/stats|udm-rus_stems}} || || ||
  +
|-
  +
| '''tur''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_stems}} || ''[[Apertium-cv-tr|cv-tr]]''<br>{{#lst:Apertium-cv-tr/stats|cv-tr_stems}} || || || || || ||
  +
|}
  +
  +
== The languages ==
  +
  +
=== Volga-Kama languages by subgroup ===
  +
* [[Turkic languages|Turkic]]
  +
** North Qıpçaq: [[Tatar]], [[Bashqort]]
  +
** Oğur: [[Chuvash]]
  +
  +
* [[Uralic languages|Uralic]] → Finno-Ugric → Finno-Permic
  +
** Permic: [[Komi]] (Komi-Zyrian, Komi-Permyak, Komi-Yazva), [[Udmurt]]
  +
** Finno-Volgaic
  +
*** [[Mari]]: [[Meadow Mari|Meadow Mari (Eastern)]], [[Hill Mari|Hill Mari (Western)]]
  +
*** [[Mordvin]]: [[Erzya]], [[Moksha]]
  +
  +
=== Volga-Kama language vulnerability ===
  +
  +
The following table shows information about Volga-Kama varieties.
   
 
{|class="wikitable sortable"
 
{|class="wikitable sortable"
Line 5: Line 172:
 
! language !! iso !! num speakers !! UNESCO classification
 
! language !! iso !! num speakers !! UNESCO classification
 
|-
 
|-
| Tatar || <code>tat</code> || 6000K? ||
+
| Tatar || <code>tat</code> || 6500K || 0. none
 
|-
 
|-
| Bashqort || <code>bak</code> || 1379K || vulnerable
+
| Bashqort || <code>bak</code> || 1379K || 1. vulnerable
 
|-
 
|-
| Chuvash || <code>chv</code> || 1325K || vulnerable
+
| Chuvash || <code>chv</code> || 1325K || 1. vulnerable
 
|-
 
|-
| Udmurt || <code>udm</code> || 0464K || definitely endangered
+
| Udmurt || <code>udm</code> || 0464K || 2. definitely endangered
 
|-
 
|-
| Eastern Mari || <code>mhr</code> || 0414K || definitely endangered
+
| Mari - Eastern || <code>mhr</code> || 0414K || 2. definitely endangered
 
|-
 
|-
| Erzya (Mordvin) || <code>myv</code> || 0400K || definitely endangered
+
| Mordvin - Erzya || <code>myv</code> || 0400K || 2. definitely endangered
 
|-
 
|-
| Komi Zyryan || <code>kpv</code> || 0217K || definitely endangered
+
| Komi - Zyryan || <code>kpv</code> || 0217K || 2. definitely endangered
 
|-
 
|-
| Moksha (Mordvin) || <code>mdf</code> || 0200K || definitely endangered
+
| Mordvin&nbsp;-&nbsp;Moksha || <code>mdf</code> || 0200K || 2. definitely endangered
 
|-
 
|-
| Komi Permyak || <code>koi</code> || 0094K || definitely endangered
+
| Komi - Permyak || <code>koi</code> || 0094K || 2. definitely endangered
 
|-
 
|-
| Western Mari || <code>mrj</code> || 0037K || severely endangered
+
| Mari - Western || <code>mrj</code> || 0037K || 3. severely endangered
 
|-
 
|-
| Komi Yazva || <code>koi</code> || <0000K || severely endangered
+
| Komi - Yazva || <code>koi</code> || 0000K || 3. severely endangered
 
|}
 
|}
  +
  +
== Existing general resources ==
  +
=== Grammars ===
  +
=== Dictionaries ===
  +
  +
== Existing computational resources ==
  +
=== Corpora and corpora projects ===
  +
* [http://www.hum.utu.fi/oppiaineet/volga/en/materials/ University of Turku - Research Unit for Volgaic Languages]
  +
=== Spell-checkers ===
  +
=== Text-to-speech and speech-to-text systems ===
  +
=== Keyboards ===
  +
* Xkb includes keyboards for the following languages:
  +
** Tatar
  +
** Chuvash
  +
** ...?
  +
=== Morphological Transducers ===
  +
* [http://www.doria.fi/handle/10024/45006 Mari]
  +
  +
== Scholarship ==
  +
  +
[[Category:Languages of the former Soviet Union]]
  +
[[Category:Languages of the Volga-Kama region]]
  +
[[Category:Turkic languages]]
  +
[[Category:Uralic languages]]

Latest revision as of 23:25, 22 December 2014

The languages of the Volga-Kama region include several Turkic and Uralic languages spoken in the Volga-Kama region (along the Volga and Kama rivers) in Russia. These include [varieties of] Tatar, Bashqort, Chuvash, Mari, Komi, Mordvin, and Udmurt (and linguistically, to some extent, Russian).

The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

Status[edit]

The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

Transducers[edit]

Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".

name Language ISO 639 formalism state stems coverage location primary authors
-2 -3
apertium-myv Erzya myv HFST (lexc+twol) development 74,977 apertium-myv-fin (incubator) Fran, Jack Rueter
apertium-tat Tatar tt tat HFST (lexc+twol) production 55,702 ~91% apertium-tat (languages) Ilnar, Fran, Jonathan, Röstäm
apertium-chv Chuvash cv chv HFST (lexc+twol) development 8,579 ~85% apertium-chv (languages) Hèctor
apertium-bak Bashkir ba bak HFST (lexc+twol) development 2,827 ~66% apertium-bak (languages) Fran, Jonathan, Ilnar, Milli
apertium-mrj Hill Mari mrj HFST (lexc+twol) development 53,051 apertium-mrj-fin (incubator) Fran, kuprina, jackrueter
apertium-udm Udmurt udm HFST (lexc+twol) prototype 196 apertium-udm-rus (nursery) Fran, Trond, Andrey, Лукерья, Алексей
apertium-kpv Komi-Zyrian kpv HFST (lexc+twol) prototype 135 apertium-kpv-mhr (incubator) Fran, Trond, Fedina, Andrei Chemyshev
apertium-mhr Meadow Mari mhr HFST (lexc+twol) prototype 117 apertium-kpv-mhr (incubator) Fran, Fedina, Andrei Chemyshev

Existing language pairs[edit]

Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.

tat chv bak mrj udm mhr myv kpv
tat - chv-tat
198
tat-bak
2,941
chv chv-tat
198
-
bak tat-bak
2,941
-
mrj -
udm -
mhr - kpv-mhr
127
myv -
kpv kpv-mhr
127
-
fin mrj-fin
273
fin-udm
93
myv-fin
401
kpv-fin
1
kaz 'kaz-tat
'
kir tat-kir
rus tat-rus
5,999
cv-ru
75
udm-rus
148
tur tur-tat
3,317
cv-tr
100

The languages[edit]

Volga-Kama languages by subgroup[edit]

Volga-Kama language vulnerability[edit]

The following table shows information about Volga-Kama varieties.

language iso num speakers UNESCO classification
Tatar tat 6500K 0. none
Bashqort bak 1379K 1. vulnerable
Chuvash chv 1325K 1. vulnerable
Udmurt udm 0464K 2. definitely endangered
Mari - Eastern mhr 0414K 2. definitely endangered
Mordvin - Erzya myv 0400K 2. definitely endangered
Komi - Zyryan kpv 0217K 2. definitely endangered
Mordvin - Moksha mdf 0200K 2. definitely endangered
Komi - Permyak koi 0094K 2. definitely endangered
Mari - Western mrj 0037K 3. severely endangered
Komi - Yazva koi 0000K 3. severely endangered

Existing general resources[edit]

Grammars[edit]

Dictionaries[edit]

Existing computational resources[edit]

Corpora and corpora projects[edit]

Spell-checkers[edit]

Text-to-speech and speech-to-text systems[edit]

Keyboards[edit]

  • Xkb includes keyboards for the following languages:
    • Tatar
    • Chuvash
    • ...?

Morphological Transducers[edit]

Scholarship[edit]