Difference between revisions of "Languages of the Volga-Kama region"

From Apertium
Jump to navigation Jump to search
Line 1: Line 1:
 
{{TOCD}}
 
{{TOCD}}
 
The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]).
 
The languages of the Volga-Kama region include several [[Turkic languages|Turkic]] and [[Uralic languages]] spoken in the Volga-Kama region (along the Volga and Kama rivers) in [[Russia]]. These include [varieties of] [[Tatar]], [[Bashqort]], [[Chuvash]], [[Mari]], [[Komi]], [[Mordvin]], and [[Udmurt]] (and linguistically, to some extent, [[Russian]]).
  +
  +
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
  +
  +
==Status==
  +
The ultimate goal is to have multi-purposable transducers for a variety of Balkan languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
  +
  +
===Transducers===
  +
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
  +
  +
{| class="wikitable sortable"
  +
|-
  +
!rowspan=2| name
  +
!rowspan=2| Language
  +
!colspan=2 class="unsortable"| ISO 639
  +
!rowspan=2| speakers
  +
!rowspan=2| UNESCO
  +
!rowspan=2| formalism
  +
!rowspan=2| state
  +
!rowspan=2| stems
  +
!rowspan=2| coverage
  +
!rowspan=2| location
  +
!rowspan=2 class="unsortable"| primary authors
  +
|-class="sortbottom"
  +
! -2
  +
! -3
  +
|-
  +
|| <code>[[apertium-tat]]</code>
  +
|| [[Tatar]]
  +
|| <code>tt</code>
  +
|| <code>tat</code>
  +
|align="right"| 6500K
  +
|align="right"| 0 (none)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| production
  +
|align="right"| {{#lst:Apertium-tat/stats|stems}}
  +
|align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
  +
|| [[apertium-tat]] ([[languages]])
  +
|| [[User:Ilnar.salimzyan|Ilnar]], [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], Milli
  +
|-
  +
| <code>[[apertium-chv]]</code>
  +
|| [[Chuvash]]
  +
|| <code>cv</code>
  +
|| <code>chv</code>
  +
|align="right"| 1325K
  +
|align="right"| 1 (vulnerable)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{:apertium-chv/stems}}
  +
|align="center"| [[apertium-chv#Current_State|~{{:apertium-chv/stats/average}}%]]
  +
|| [[apertium-chv]]&nbsp;([[languages]])
  +
|| [[User:Hectoralos|Hèctor]]
  +
|-
  +
|| <code>[[apertium-bak]]</code>
  +
|| [[Bashkir]]
  +
|| <code>ba</code>
  +
|| <code>bak</code>
  +
|align="right"| 1379K
  +
|align="right"| 1 (vulnerable)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{:apertium-bak/stems}}
  +
|align="center"| [[apertium-bak#Current_State|~{{:apertium-bak/stats/average}}%]]
  +
|| [[apertium-bak]]&nbsp;([[languages]])
  +
|| [[User:Francis Tyers|Fran]], [[User:Firespeaker|Jonathan]], [[User:Ilnar.salimzyan|Ilnar]], Milli
  +
|-
  +
| <code>[[apertium-udm]]</code>
  +
|| [[Udmurt]]
  +
|align="center"| <code>&ndash;</code>
  +
|| <code>udm</code>
  +
|align="right"| 464K
  +
|align="right"| 2 (definitely endangered)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| ?
  +
|align="center"| ?
  +
|| [[apertium-fin-udm]]&nbsp;([[incubator]]) <br> [[apertium-udm-rus]]&nbsp;([[nursery]])
  +
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], [[User:Andrewboltachev|Andrey]], Лукерья, Алексей
  +
|-
  +
| <code>[[apertium-myv]]</code>
  +
|| [[Erzya]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>myv</code>
  +
|align="right"| 400K
  +
|align="right"| 2 (definitely endangered)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| {{#lst:Apertium-myv-fin/stats|myv-stems}}
  +
|align="center"| ?
  +
|| [[apertium-myv-fin]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], Jack Rueter
  +
|-
  +
| <code>[[apertium-mhr]]</code>
  +
|| [[Eastern Mari]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>mhr</code>
  +
|align="right"| 414K
  +
|align="right"| 2 (definitely endangered)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| ?
  +
|align="center"| {{#lst:Apertium-kpv-mhr/stats|mhr-stems}}
  +
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], Fedina, chemyshev
  +
|-
  +
| <code>[[apertium-kpv]]</code>
  +
|| [[Komi-Zyrian]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>kpv</code>
  +
|align="right"| 217K
  +
|align="right"| 2 (definitely endangered)
  +
|| [[HFST|HFST (lexc+twol)]]
  +
|| development
  +
|align="right"| ?
  +
|align="center"| ?
  +
|| [[apertium-kpv-mhr]]&nbsp;([[incubator]]) <br> [[apertium-kpv-fin]]&nbsp;([[incubator]])
  +
|| [[User:Francis_Tyers|Fran]], [[User:Trondtr|Trond]], Fedina, chemyshev
  +
|-
  +
| <code>[[apertium-mdf]]</code>
  +
|| [[Moksha]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>mdf</code>
  +
|align="right"| 200K
  +
|align="right"| 2 (definitely endangered)
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|-
  +
| <code>[[apertium-koi]]</code>
  +
|| [[Komi-Permyak]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>koi</code>
  +
|align="right"| 94K
  +
|align="right"| 2 (definitely endangered)
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|-
  +
| <code>[[apertium-mrj]]</code>
  +
|| [[Western Mari]]
  +
|align="center"|<code>&ndash;</code>
  +
|| <code>mrj</code>
  +
|align="right"| 37K
  +
|align="right"| 3 (severely endangered)
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|-
  +
| <code>[[apertium-kpvyaz]]</code>
  +
|| [[Komi-Yazva]]
  +
|align="center"|<code>&ndash;</code>
  +
|align="center"|<code>&ndash;</code>
  +
|align="right"| 0K
  +
|align="right"| 3 (severely endangered)
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|align="center"| &ndash;
  +
|}
  +
  +
=== Existing language pairs ===
  +
  +
==== Volga-Kama&ndash;Volga-Kama pairs ====
  +
  +
Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk.
  +
  +
{| style="text-align: center;" class="wikitable"
  +
|- style="background: #ececec"
  +
! !! tat !! chv !! bak !! udm !! mhr !! kpv
  +
|-
  +
| '''tat''' || - || ''[[apertium-cv-tt|cv-tt]]'' || ''[[apertium-tat-bak|tat-bak]]'' || || ||
  +
|-
  +
| '''chv''' || ''[[apertium-cv-tt|cv-tt]]'' || - || || || ||
  +
|-
  +
| '''bak''' || ''[[apertium-tat-bak|tat-bak]]'' || || - || || ||
  +
|-
  +
| '''udm''' || || || || - || ||
  +
|-
  +
| '''mhr''' || || || || || - || ''[[apertium-kpv-mhr|kpv-mhr]]''
  +
|-
  +
| '''kpv''' || || || || || ''[[apertium-kpv-mhr|kpv-mhr]]'' || -
  +
|}
  +
  +
==== Pairs with non&ndash;Volga-Kama languages ====
  +
{| style="text-align: center;" class="wikitable"
  +
|- style="background: #ececec"
  +
! !! tat !! chv !! bak !! udm !! mhr !! kpv
  +
|-
  +
| '''ru''' || ''[[apertium-tt-ru|tt-ru]]'' || ''[[apertium-cv-ru|cv-ru]]'' || || ''[[apertium-udm-rus|udm-rus]]'' || ||
  +
|-
  +
| '''ky''' || ''[[apertium-tt-ky|tt-ky]]'' || || || || ||
  +
|-
  +
| '''tr''' || || ''[[apertium-cv-tr|cv-tr]]'' || || || ||
  +
|-
  +
| '''fin''' || || || || ''[[apertium-fin-udm|fin-udm]]'' || || ''[[apertium-kpv-fin|kpv-fin]]''
  +
|}
  +
  +
==== Table of dix progress ====
  +
{| style="text-align: center;" class="wikitable"
  +
|- style="background: #ececec"
  +
! !! tat !! chv !! bak !! udm !! mhr !! kpv
  +
|-
  +
| '''tat''' || - || ? || ? || || ||
  +
|-
  +
| '''chv''' || ? || - || || || ||
  +
|-
  +
| '''bak''' || ? || || - || || ||
  +
|-
  +
| '''udm''' || || || || - || ||
  +
|-
  +
| '''mhr''' || || || || || - || ?
  +
|-
  +
| '''kpv''' || || || || || ? || -
  +
|-
  +
| || || || || || ||
  +
|-
  +
| '''ru''' || ? || ? || || ? || ||
  +
|-
  +
| '''ky''' || ? || || || || ||
  +
|-
  +
| '''tr''' || || ? || || || ||
  +
|-
  +
| '''fin''' || || || || ? || || ?
  +
|}
   
 
== The languages ==
 
== The languages ==

Revision as of 22:34, 27 December 2013

The languages of the Volga-Kama region include several Turkic and Uralic languages spoken in the Volga-Kama region (along the Volga and Kama rivers) in Russia. These include [varieties of] Tatar, Bashqort, Chuvash, Mari, Komi, Mordvin, and Udmurt (and linguistically, to some extent, Russian).

The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.

Status

The ultimate goal is to have multi-purposable transducers for a variety of Balkan languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.

Transducers

Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".

name Language ISO 639 speakers UNESCO formalism state stems coverage location primary authors
-2 -3
apertium-tat Tatar tt tat 6500K 0 (none) HFST (lexc+twol) production 55,702 ~91% apertium-tat (languages) Ilnar, Fran, Jonathan, Milli
apertium-chv Chuvash cv chv 1325K 1 (vulnerable) HFST (lexc+twol) development 8,579 ~85% apertium-chv (languages) Hèctor
apertium-bak Bashkir ba bak 1379K 1 (vulnerable) HFST (lexc+twol) development 2,827 ~66% apertium-bak (languages) Fran, Jonathan, Ilnar, Milli
apertium-udm Udmurt udm 464K 2 (definitely endangered) HFST (lexc+twol) development ? ? apertium-fin-udm (incubator)
apertium-udm-rus (nursery)
Fran, Trond, Andrey, Лукерья, Алексей
apertium-myv Erzya myv 400K 2 (definitely endangered) HFST (lexc+twol) development ? apertium-myv-fin (incubator) Fran, Jack Rueter
apertium-mhr Eastern Mari mhr 414K 2 (definitely endangered) HFST (lexc+twol) development ? apertium-kpv-mhr (incubator) Fran, Fedina, chemyshev
apertium-kpv Komi-Zyrian kpv 217K 2 (definitely endangered) HFST (lexc+twol) development ? ? apertium-kpv-mhr (incubator)
apertium-kpv-fin (incubator)
Fran, Trond, Fedina, chemyshev
apertium-mdf Moksha mdf 200K 2 (definitely endangered)
apertium-koi Komi-Permyak koi 94K 2 (definitely endangered)
apertium-mrj Western Mari mrj 37K 3 (severely endangered)
apertium-kpvyaz Komi-Yazva 0K 3 (severely endangered)

Existing language pairs

Volga-Kama–Volga-Kama pairs

Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.

tat chv bak udm mhr kpv
tat - cv-tt tat-bak
chv cv-tt -
bak tat-bak -
udm -
mhr - kpv-mhr
kpv kpv-mhr -

Pairs with non–Volga-Kama languages

tat chv bak udm mhr kpv
ru tt-ru cv-ru udm-rus
ky tt-ky
tr cv-tr
fin fin-udm kpv-fin

Table of dix progress

tat chv bak udm mhr kpv
tat - ? ?
chv ? -
bak ? -
udm -
mhr - ?
kpv ? -
ru ? ? ?
ky ?
tr ?
fin ? ?

The languages

The following table shows information about Volga-Kama varieties and information about apertium projects related to the languages.

language iso num speakers UNESCO classification Apertium support
Tatar tat 6500K 0. none incubator/apertium-tr-tt/

incubator/apertium-tt-kk/ incubator/apertium-tt-ky/ incubator/apertium-tt-ru/ incubator/apertium-cv-tt/ nursery/apertium-tt-ba/

Bashqort bak 1379K 1. vulnerable nursery/apertium-tt-ba/
Chuvash chv 1325K 1. vulnerable incubator/apertium-cv-ru/

incubator/apertium-cv-tr/ incubator/apertium-cv-tt/

Udmurt udm 0464K 2. definitely endangered incubator/apertium-fin-udm/

nursery/apertium-udm-rus/

Mari - Eastern mhr 0414K 2. definitely endangered incubator/apertium-kpv-mhr/
Mordvin - Erzya myv 0400K 2. definitely endangered
Komi - Zyryan kpv 0217K 2. definitely endangered incubator/apertium-kpv-mhr/
Mordvin - Moksha mdf 0200K 2. definitely endangered
Komi - Permyak koi 0094K 2. definitely endangered
Mari - Western mrj 0037K 3. severely endangered
Komi - Yazva koi 0000K 3. severely endangered

Existing general resources

Grammars

Dictionaries

Existing computational resources

Corpora and corpora projects

Spell-checkers

Text-to-speech and speech-to-text systems

Keyboards

  • Xkb includes keyboards for the following languages:
    • Tatar
    • Chuvash
    • ...?

Morphological Transducers

Scholarship