Difference between revisions of "Languages of the Volga-Kama region"
Firespeaker (talk | contribs) m |
|||
(33 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
+ | {{TOCD}} |
||
− | The languages of the Volga-Kama region include [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and to some extent [[Russian]]). |
||
+ | The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]). |
||
+ | |||
+ | The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below. |
||
+ | |||
+ | ==Status== |
||
+ | The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs. |
||
+ | |||
+ | ===Transducers=== |
||
+ | Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production". |
||
+ | |||
+ | {| class="wikitable sortable" |
||
+ | |- |
||
+ | !rowspan=2| name |
||
+ | !rowspan=2| Language |
||
+ | !colspan=2 class="unsortable"| ISO 639 |
||
+ | !rowspan=2| formalism |
||
+ | !rowspan=2| state |
||
+ | !rowspan=2| stems |
||
+ | !rowspan=2| coverage |
||
+ | !rowspan=2| location |
||
+ | !rowspan=2 class="unsortable"| primary authors |
||
+ | |-class="sortbottom" |
||
+ | ! -2 |
||
+ | ! -3 |
||
+ | |- |
||
+ | | <code>[[apertium-myv]]</code> |
||
+ | || [[Erzya]] |
||
+ | |align="center"|<code>–</code> |
||
+ | || <code>myv</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || development |
||
+ | |align="right"| {{#lst:Apertium-myv-fin/stats|myv_stems}} |
||
+ | |align="center"| |
||
+ | || [[apertium-myv-fin]] ([[incubator]]) |
||
+ | || [[User:Francis_Tyers|Fran]], Jack Rueter |
||
+ | |- |
||
+ | || <code>[[apertium-tat]]</code> |
||
+ | || [[Tatar]] |
||
+ | || <code>tt</code> |
||
+ | || <code>tat</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || {{#lst:Apertium-tat/stats|state}} |
||
+ | |align="right"| {{#lst:Apertium-tat/stats|stems}} |
||
+ | |align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]] |
||
+ | || {{#lst:Apertium-tat/stats|location}} |
||
+ | || {{#lst:Apertium-tat/stats|authors}} |
||
+ | |- |
||
+ | | <code>[[apertium-chv]]</code> |
||
+ | || [[Chuvash]] |
||
+ | || <code>cv</code> |
||
+ | || <code>chv</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || development |
||
+ | |align="right"| {{:apertium-chv/stems}} |
||
+ | |align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]] |
||
+ | || [[apertium-chv]] ([[languages]]) |
||
+ | || [[User:Hectoralos|Hèctor]] |
||
+ | |- |
||
+ | || <code>[[apertium-bak]]</code> |
||
+ | || [[Bashkir]] |
||
+ | || <code>ba</code> |
||
+ | || <code>bak</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || development |
||
+ | |align="right"| {{:apertium-bak/stems}} |
||
+ | |align="center"| [[apertium-bak#Current_State|~{{:apertium-bak/stats/average}}%]] |
||
+ | || [[apertium-bak]] ([[languages]]) |
||
+ | || [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli |
||
+ | |- |
||
+ | | <code>[[apertium-mrj]]</code> |
||
+ | || [[Hill Mari]] |
||
+ | |align="center"|<code>–</code> |
||
+ | || <code>mrj</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || development |
||
+ | |align="right"| {{#lst:Apertium-mrj-fin/stats|mrj_stems}} |
||
+ | |align="center"| |
||
+ | || [[apertium-mrj-fin]] ([[incubator]]) |
||
+ | || [[User:Francis_Tyers|Fran]], kuprina, jackrueter |
||
+ | |- |
||
+ | | <code>[[apertium-udm]]</code> |
||
+ | || [[Udmurt]] |
||
+ | |align="center"| <code>–</code> |
||
+ | || <code>udm</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || prototype |
||
+ | |align="right"| {{#lst:Apertium-udm-rus/stats|udm_stems}} |
||
+ | |align="center"| |
||
+ | || [[apertium-udm-rus]] ([[nursery]]) |
||
+ | || [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей |
||
+ | |- |
||
+ | | <code>[[apertium-kpv]]</code> |
||
+ | || [[Komi-Zyrian]] |
||
+ | |align="center"|<code>–</code> |
||
+ | || <code>kpv</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || prototype |
||
+ | |align="right"| {{#lst:Apertium-kpv-mhr/stats|kpv_stems}} |
||
+ | |align="center"| |
||
+ | || [[apertium-kpv-mhr]] ([[incubator]]) |
||
+ | || [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, Andrei Chemyshev |
||
+ | |- |
||
+ | | <code>[[apertium-mhr]]</code> |
||
+ | || [[Meadow Mari]] |
||
+ | |align="center"|<code>–</code> |
||
+ | || <code>mhr</code> |
||
+ | || [[HFST|HFST (lexc+twol)]] |
||
+ | || prototype |
||
+ | |align="right"| {{#lst:Apertium-kpv-mhr/stats|mhr_stems}} |
||
+ | |align="center"| |
||
+ | || [[apertium-kpv-mhr]] ([[incubator]]) |
||
+ | || [[User:Francis_Tyers|Fran]], Fedina, Andrei Chemyshev |
||
+ | |} |
||
+ | |||
+ | === Existing language pairs === |
||
+ | |||
+ | Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk. |
||
+ | |||
+ | {| style="text-align: center;" class="wikitable dixtable" |
||
+ | |- style="background: #ececec" |
||
+ | ! !! tat !! chv !! bak !! mrj !! udm !! mhr !! myv !! kpv |
||
+ | |- |
||
+ | | '''tat''' || - || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || || || || |
||
+ | |- |
||
+ | | '''chv''' || ''[[Apertium-chv-tat|chv-tat]]''<br>{{#lst:Apertium-chv-tat/stats|chv-tat_stems}} || - || || || || || || |
||
+ | |- |
||
+ | | '''bak''' || [[Apertium-tat-bak|tat-bak]]<br>{{#lst:Apertium-tat-bak/stats|tat-bak_stems}} || || - || || || || || |
||
+ | |- |
||
+ | | '''mrj''' || || || || - || || || || |
||
+ | |- |
||
+ | | '''udm''' || || || || || - || || || |
||
+ | |- |
||
+ | | '''mhr''' || || || || || || - || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}} |
||
+ | |- |
||
+ | | '''myv''' || || || || || || || - || |
||
+ | |- |
||
+ | | '''kpv''' || || || || || || ''[[Apertium-kpv-mhr|kpv-mhr]]''<br>{{#lst:Apertium-kpv-mhr/stats|kpv-mhr_stems}} || || - |
||
+ | |- |
||
+ | | || || || || || || || || |
||
+ | |- |
||
+ | | '''fin''' || || || || ''[[Apertium-mrj-fin|mrj-fin]]''<br>{{#lst:Apertium-mrj-fin/stats|mrj-fin_stems}} || ''[[Apertium-fin-udm|fin-udm]]''<br>{{#lst:Apertium-fin-udm/stats|fin-udm_stems}} || || ''[[Apertium-myv-fin|myv-fin]]''<br>{{#lst:Apertium-myv-fin/stats|myv-fin_stems}} || ''[[Apertium-kpv-fin|kpv-fin]]''<br>{{#lst:Apertium-kpv-fin/stats|kpv-fin_stems}} |
||
+ | |- |
||
+ | | '''kaz''' || '''[[Apertium-kaz-tat|kaz-tat]]'''<br>'''{{#lst:Apertium-kaz-tat/stats|kaz-tat_stems}}''' || || || || || || || |
||
+ | |- |
||
+ | | '''kir''' || ''[[Apertium-tat-kir|tat-kir]]''<br>{{#lst:Apertium-tat-kir/stats|tat-kir_stems}} || || || || || || || |
||
+ | |- |
||
+ | | '''rus''' || [[Apertium-tat-rus|tat-rus]]<br>{{#lst:Apertium-tat-rus/stats|tat-rus_stems}} || ''[[Apertium-cv-ru|cv-ru]]''<br>{{#lst:Apertium-cv-ru/stats|cv-ru_stems}} || || || [[Apertium-udm-rus|udm-rus]]<br>{{#lst:Apertium-udm-rus/stats|udm-rus_stems}} || || || |
||
+ | |- |
||
+ | | '''tur''' || [[Apertium-tur-tat|tur-tat]]<br>{{#lst:Apertium-tur-tat/stats|tur-tat_stems}} || ''[[Apertium-cv-tr|cv-tr]]''<br>{{#lst:Apertium-cv-tr/stats|cv-tr_stems}} || || || || || || |
||
+ | |} |
||
+ | |||
+ | == The languages == |
||
+ | |||
+ | === Volga-Kama languages by subgroup === |
||
+ | * [[Turkic languages|Turkic]] |
||
+ | ** North Qıpçaq: [[Tatar]], [[Bashqort]] |
||
+ | ** Oğur: [[Chuvash]] |
||
+ | |||
+ | * [[Uralic languages|Uralic]] → Finno-Ugric → Finno-Permic |
||
+ | ** Permic: [[Komi]] (Komi-Zyrian, Komi-Permyak, Komi-Yazva), [[Udmurt]] |
||
+ | ** Finno-Volgaic |
||
+ | *** [[Mari]]: [[Meadow Mari|Meadow Mari (Eastern)]], [[Hill Mari|Hill Mari (Western)]] |
||
+ | *** [[Mordvin]]: [[Erzya]], [[Moksha]] |
||
+ | |||
+ | === Volga-Kama language vulnerability === |
||
+ | |||
+ | The following table shows information about Volga-Kama varieties. |
||
{|class="wikitable sortable" |
{|class="wikitable sortable" |
||
Line 5: | Line 172: | ||
! language !! iso !! num speakers !! UNESCO classification |
! language !! iso !! num speakers !! UNESCO classification |
||
|- |
|- |
||
− | | Tatar || <code>tat</code> || |
+ | | Tatar || <code>tat</code> || 6500K || 0. none |
|- |
|- |
||
− | | Bashqort || <code>bak</code> || 1379K || vulnerable |
+ | | Bashqort || <code>bak</code> || 1379K || 1. vulnerable |
|- |
|- |
||
− | | Chuvash || <code>chv</code> || 1325K || vulnerable |
+ | | Chuvash || <code>chv</code> || 1325K || 1. vulnerable |
|- |
|- |
||
− | | Udmurt || <code>udm</code> || 0464K || definitely endangered |
+ | | Udmurt || <code>udm</code> || 0464K || 2. definitely endangered |
|- |
|- |
||
− | | |
+ | | Mari - Eastern || <code>mhr</code> || 0414K || 2. definitely endangered |
|- |
|- |
||
− | | |
+ | | Mordvin - Erzya || <code>myv</code> || 0400K || 2. definitely endangered |
|- |
|- |
||
− | | Komi Zyryan || <code>kpv</code> || 0217K || definitely endangered |
+ | | Komi - Zyryan || <code>kpv</code> || 0217K || 2. definitely endangered |
|- |
|- |
||
− | | Moksha |
+ | | Mordvin - Moksha || <code>mdf</code> || 0200K || 2. definitely endangered |
|- |
|- |
||
− | | Komi Permyak || <code>koi</code> || 0094K || definitely endangered |
+ | | Komi - Permyak || <code>koi</code> || 0094K || 2. definitely endangered |
|- |
|- |
||
− | | |
+ | | Mari - Western || <code>mrj</code> || 0037K || 3. severely endangered |
|- |
|- |
||
− | | Komi Yazva || <code>koi</code> || |
+ | | Komi - Yazva || <code>koi</code> || 0000K || 3. severely endangered |
|} |
|} |
||
+ | |||
+ | == Existing general resources == |
||
+ | === Grammars === |
||
+ | === Dictionaries === |
||
+ | |||
+ | == Existing computational resources == |
||
+ | === Corpora and corpora projects === |
||
+ | * [http://www.hum.utu.fi/oppiaineet/volga/en/materials/ University of Turku - Research Unit for Volgaic Languages] |
||
+ | === Spell-checkers === |
||
+ | === Text-to-speech and speech-to-text systems === |
||
+ | === Keyboards === |
||
+ | * Xkb includes keyboards for the following languages: |
||
+ | ** Tatar |
||
+ | ** Chuvash |
||
+ | ** ...? |
||
+ | === Morphological Transducers === |
||
+ | * [http://www.doria.fi/handle/10024/45006 Mari] |
||
+ | |||
+ | == Scholarship == |
||
+ | |||
+ | [[Category:Languages of the former Soviet Union]] |
||
+ | [[Category:Languages of the Volga-Kama region]] |
||
+ | [[Category:Turkic languages]] |
||
+ | [[Category:Uralic languages]] |
Latest revision as of 23:25, 22 December 2014
The languages of the Volga-Kama region include several Turkic and Uralic languages spoken in the Volga-Kama region (along the Volga and Kama rivers) in Russia. These include [varieties of] Tatar, Bashqort, Chuvash, Mari, Komi, Mordvin, and Udmurt (and linguistically, to some extent, Russian).
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
Status[edit]
The ultimate goal is to have multi-purposable transducers for a variety of Volga-Kama languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
Transducers[edit]
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
Existing language pairs[edit]
Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.
tat | chv | bak | mrj | udm | mhr | myv | kpv | |
---|---|---|---|---|---|---|---|---|
tat | - | chv-tat 198 |
tat-bak 2,941 |
|||||
chv | chv-tat 198 |
- | ||||||
bak | tat-bak 2,941 |
- | ||||||
mrj | - | |||||||
udm | - | |||||||
mhr | - | kpv-mhr 127 | ||||||
myv | - | |||||||
kpv | kpv-mhr 127 |
- | ||||||
fin | mrj-fin 273 |
fin-udm 93 |
myv-fin 401 |
kpv-fin 1 | ||||
kaz | 'kaz-tat ' |
|||||||
kir | tat-kir |
|||||||
rus | tat-rus 5,999 |
cv-ru 75 |
udm-rus 148 |
|||||
tur | tur-tat 3,317 |
cv-tr 100 |
The languages[edit]
Volga-Kama languages by subgroup[edit]
- Uralic → Finno-Ugric → Finno-Permic
Volga-Kama language vulnerability[edit]
The following table shows information about Volga-Kama varieties.
language | iso | num speakers | UNESCO classification |
---|---|---|---|
Tatar | tat |
6500K | 0. none |
Bashqort | bak |
1379K | 1. vulnerable |
Chuvash | chv |
1325K | 1. vulnerable |
Udmurt | udm |
0464K | 2. definitely endangered |
Mari - Eastern | mhr |
0414K | 2. definitely endangered |
Mordvin - Erzya | myv |
0400K | 2. definitely endangered |
Komi - Zyryan | kpv |
0217K | 2. definitely endangered |
Mordvin - Moksha | mdf |
0200K | 2. definitely endangered |
Komi - Permyak | koi |
0094K | 2. definitely endangered |
Mari - Western | mrj |
0037K | 3. severely endangered |
Komi - Yazva | koi |
0000K | 3. severely endangered |
Existing general resources[edit]
Grammars[edit]
Dictionaries[edit]
Existing computational resources[edit]
Corpora and corpora projects[edit]
Spell-checkers[edit]
Text-to-speech and speech-to-text systems[edit]
Keyboards[edit]
- Xkb includes keyboards for the following languages:
- Tatar
- Chuvash
- ...?