Difference between revisions of "Balkan languages"
(Update to new style) |
|||
Line 1: | Line 1: | ||
{{TOCD}} |
{{TOCD}} |
||
'''Balkan languages''' are those languages spoken in the Balkans, and possibly forming a part of the Balkan Sprachbund. |
The '''Balkan languages''' are those languages spoken in the Balkans, and possibly forming a part of the Balkan Sprachbund. They include [[Bulgarian]], [[Macedonian]], [[Romanian]], [[Aromanian]], [[Albanian]], [[Greek]], [[Serbo-Croatian]], and a number of others. |
||
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below. |
|||
==Status== |
|||
The ultimate goal is to have multi-purposable transducers for a variety of Balkan languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs. |
|||
===Transducers=== |
|||
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production". |
|||
{| class="wikitable sortable" |
|||
|- |
|||
!rowspan=2| name |
|||
!rowspan=2| Language |
|||
!colspan=2 class="unsortable"| ISO 639 |
|||
!rowspan=2| formalism |
|||
!rowspan=2| state |
|||
!rowspan=2| stems |
|||
!rowspan=2| paradigms |
|||
!rowspan=2| coverage |
|||
!rowspan=2| location |
|||
!rowspan=2 class="unsortable"| primary authors |
|||
|-class="sortbottom" |
|||
! -2 |
|||
! -3 |
|||
|- |
|||
|| <code>[[apertium-mkd]]</code> |
|||
|| [[Macedonian]] |
|||
|| <code>mk</code> |
|||
|| <code>mkd</code> |
|||
|| [[lttoolbox]] |
|||
|| production |
|||
|align="right"| {{#lst:Apertium-mkd/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-mkd/stats|paradigms}} |
|||
|align="center"| [[Apertium-mkd#Current_State|~{{:Apertium-mkd/stats/average}}%]] |
|||
|| [[apertium-mkd]] ([[languages]]) |
|||
|| [[User:Francis Tyers|Fran]], [[User:Tihomir|Tihomir]], [[User:Fpetkovski|Petkovski]] |
|||
|- |
|||
|| <code>[[apertium-hbs]]</code> |
|||
|| [[Serbo-Croatian]] |
|||
|| <code>sh</code> |
|||
|| <code>hbs</code> |
|||
|| [[lttoolbox]] |
|||
|| working |
|||
|align="right"| {{#lst:Apertium-hbs/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-hbs/stats|paradigms}} |
|||
|align="center"| [[Apertium-hbs#Current_State|~{{:Apertium-hbs/stats/average}}%]] |
|||
|| [[apertium-hbs]] ([[languages]]) |
|||
|| [[User: Francis Tyers|Fran]] |
|||
|- |
|||
|| <code>[[apertium-slv]]</code> |
|||
|| [[Slovenian]] |
|||
|| <code>sl</code> |
|||
|| <code>slv</code> |
|||
|| [[lttoolbox]] |
|||
|| production |
|||
|align="right"| {{#lst:Apertium-slv/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-slv/stats|paradigms}} |
|||
|align="center"| [[Apertium-slv#Current_State|~{{:Apertium-slv/stats/average}}%]] |
|||
|| [[apertium-hbs-slv]] ([[trunk]])<br />[[apertium-slv-pol]] ([[incubator]])<br />[[apertium-sl-mk]] ([[incubator]]) |
|||
|| [[User:Francis Tyers|Fran]], [[User:Fpetkovski|Petkovski]], [[User:Krvoje|Peradin]], Horvat, Čabrilo, Dimitrijev |
|||
|- |
|||
|| <code>[[apertium-tur]]</code> |
|||
|| [[Turkish]] |
|||
|| <code>tr</code> |
|||
|| <code>tur</code> |
|||
|| [[HFST]] |
|||
|| working |
|||
|align="right"| {{#lst:Apertium-tur/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-tur/stats|paradigms}} |
|||
|align="center"| [[Apertium-tur#Current_State|~{{:Apertium-tur/stats/average}}%]] |
|||
|| [[apertium-tur]] ([[languages]]) |
|||
|| [[User:Francis Tyers|Fran]], [[User:Zfe|Gianluca]], Sezgi Aydın |
|||
|- |
|||
|| <code>[[apertium-bul]]</code> |
|||
|| [[Bulgarian]] |
|||
|| <code>bg</code> |
|||
|| <code>bul</code> |
|||
|| [[lttoolbox]] |
|||
|| production |
|||
|align="right"| {{#lst:Apertium-bul/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-bul/stats|paradigms}} |
|||
|align="center"| [[Apertium-bul#Current_State|~{{:Apertium-bul/stats/average}}%]] |
|||
|| [[apertium-bul]] ([[languages]]) |
|||
|| [[User:Francis Tyers|Fran]], [[User:Tihomir|Tihomir]] |
|||
|- |
|||
|| <code>[[apertium-sqi]]</code> |
|||
|| [[Albanian]] |
|||
|| <code>sq</code> |
|||
|| <code>sqi</code> |
|||
|| [[lttoolbox]] |
|||
|| development |
|||
|align="right"| {{#lst:Apertium-sqi/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-sqi/stats|paradigms}} |
|||
|align="center"| [[Apertium-sqi#Current_State|~{{:Apertium-sqi/stats/average}}%]] |
|||
|| [[apertium-sqi]] ([[languages]]) |
|||
|| [[User: Francis Tyers|Fran]] |
|||
|- |
|||
|| <code>[[apertium-ell]]</code> |
|||
|| [[Greek]] |
|||
|| <code>el</code> |
|||
|| <code>ell</code> |
|||
|| [[lttoolbox]] |
|||
|| ? |
|||
|align="right"| {{#lst:Apertium-ell/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-ell/stats|paradigms}} |
|||
|align="center"| - |
|||
|| [[apertium-ell]] ([[languages]]) |
|||
|| [[User:Francis Tyers|Fran]] |
|||
|- |
|||
|| <code>[[apertium-rup]]</code> |
|||
|| [[Aromanian]] |
|||
|| <code>-</code> |
|||
|| <code>rup</code> |
|||
|| [[lttoolbox]] |
|||
|| ? |
|||
|align="right"| {{#lst:Apertium-rup/stats|stems}} |
|||
|align="right"| {{#lst:Apertium-rup/stats|paradigms}} |
|||
|align="center"| - |
|||
|| [[apertium-rup]] ([[incubator]]) |
|||
|| [[User: Francis Tyers|Fran]], shopskasalata |
|||
|- |
|||
|| <code>[[apertium-ron]]</code> |
|||
|| [[Romanian]] |
|||
|| <code>ro</code> |
|||
|| <code>ron</code> |
|||
|| [[lttoolbox]] |
|||
|| ? |
|||
|align="right"| ? |
|||
|align="right"| ? |
|||
|align="center"| - |
|||
|| [[apertium-ron-rup]] ([[incubator]]) |
|||
|| [[User: Francis Tyers|Fran]] |
|||
|} |
|||
=== Balkan Language Classification <sup><small>[https://en.wikipedia.org/wiki/Languages_of_the_Balkans]</small></sup> === |
|||
* [[Albanian]] |
|||
** [[Arvanitika]] |
|||
** [[Gheg]] |
|||
** [[Tosk]] |
|||
* [[Hellenic languages]] |
|||
** [[Cappadocian Greek]] |
|||
** [[Greek|Standard Greek]] |
|||
** [[Pontic Greek]] |
|||
** [[Tsakonian]] |
|||
* [[Romance languages]] |
|||
** [[Aromanian]] |
|||
** [[Istriot]] |
|||
** [[Istro-Romanian]] |
|||
** [[Italian]] |
|||
** [[Ladino]] |
|||
** [[Megleno-Romanian]] |
|||
** [[Romanian]] |
|||
** [[Moldovan]] |
|||
* [[Slavic languages]] |
|||
** [[Western South Slavic]] |
|||
*** [[Serbo-Croatian]] |
|||
*** [[Slovenian]] |
|||
** [[Eastern South Slavic]] |
|||
*** [[Bulgarian]] |
|||
*** [[Macedonian]] |
|||
* [[Indo-Aryan languages]] |
|||
** [[Romani]] |
|||
=== Existing language pairs === |
|||
==== Balkan-Balkan pairs ==== |
|||
Text in ''italic'' denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in '''bold''' denotes a stable well-working language pair in trunk. |
|||
{| style="text-align: center;" class="wikitable" |
|||
|- style="background: #ececec" |
|||
! !! bul !! mkd !! ron !! rup !! sqi !! ell !! hbs !! slv !! tur |
|||
|- |
|||
| '''bul''' || - || '''[[mk-bg]]''' || || || || ''[[bg-el]]'' || || || |
|||
|- |
|||
| '''mkd''' || || - || ''[[mk-sq]]'' || || || || || || |
|||
|- |
|||
| '''ron''' || || || - || ''[[ron-rup]]'' || || || || || |
|||
|- |
|||
| '''rup''' || || || || - || || || || || |
|||
|- |
|||
| '''sqi''' || || || || || - || || || || |
|||
|- |
|||
| '''ell''' || || || || || || - || || || |
|||
|- |
|||
| '''hbs''' || || '''[[sh-mk]]''' || || || || || - || '''[[hbs-slv]]''' || |
|||
|- |
|||
| '''slv''' || || ''[[sl-mk]]'' || || || || || || - || |
|||
|- |
|||
| '''tur''' || || || || || || || || || - |
|||
|} |
|||
==== Pairs with non-Balkan languages ==== |
|||
{| style="text-align: center;" class="wikitable" |
|||
|- style="background: #ececec" |
|||
! !! bul !! mkd !! ron !! rup !! sqi !! ell !! hbs !! slv !! tur |
|||
|- |
|||
| '''el''' || ''[[bg-el]]'' || || || || || || || || |
|||
|- |
|||
| '''ru''' || ''[[bg-ru]]'' || || || || || || ''[[hbs-rus]]'' || || |
|||
|- |
|||
| '''en''' || ''[[bg-en]]'' || '''[[mk-en]]''' || || || ''[[en-sq]]'' || ''[[ell-eng]]'' || ''[[sh-en]]'' || || ''[[tr-en]]'' |
|||
|- |
|||
| '''it''' || || || ''[[ro-it]]'' || || || || || ''[[sl-it]]'' || |
|||
|- |
|||
| '''spa''' || || || || || || || || ''[[slv-spa]]'' || |
|||
|- |
|||
| '''pol''' || || || || || || || || ''[[slv-pol]]'' || |
|||
|- |
|||
| '''eo''' || ''[[eo-bg]]'' || || || || || ''[[eo-el]]'' || || || |
|||
|- |
|||
| '''fr''' || || || ''[[fr-ro]]'' || || || || || || |
|||
|- |
|||
| '''ca''' || || || ''[[ca-ro]]'' || || || || || || |
|||
|- |
|||
| '''es''' || || || '''[[es-ro]]''' || || || || || || |
|||
|- |
|||
| '''cs''' || || || || || || || || ''[[cs-sl]]'' || |
|||
|- |
|||
| '''kir''' || || || || || || || || || ''[[tur-kir]]'' |
|||
|- |
|||
| '''tat''' || || || || || || || || || ''[[tur-tat]]'' |
|||
|- |
|||
| '''uzb''' || || || || || || || || || ''[[tur-uzb]]'' |
|||
|- |
|||
| '''aze''' || || || || || || || || || [[tur-aze]] |
|||
|- |
|||
| '''cv''' || || || || || || || || || ''[[cv-tr]]'' |
|||
|} |
|||
==Existing== |
==Existing== |
Revision as of 09:07, 24 December 2013
The Balkan languages are those languages spoken in the Balkans, and possibly forming a part of the Balkan Sprachbund. They include Bulgarian, Macedonian, Romanian, Aromanian, Albanian, Greek, Serbo-Croatian, and a number of others.
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
Status
The ultimate goal is to have multi-purposable transducers for a variety of Balkan languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
Transducers
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
Balkan Language Classification [1]
Existing language pairs
Balkan-Balkan pairs
Text in italic denotes language pairs under development / in the incubator. Regular text denotes a functioning language pair in staging, while text in bold denotes a stable well-working language pair in trunk.
bul | mkd | ron | rup | sqi | ell | hbs | slv | tur | |
---|---|---|---|---|---|---|---|---|---|
bul | - | mk-bg | bg-el | ||||||
mkd | - | mk-sq | |||||||
ron | - | ron-rup | |||||||
rup | - | ||||||||
sqi | - | ||||||||
ell | - | ||||||||
hbs | sh-mk | - | hbs-slv | ||||||
slv | sl-mk | - | |||||||
tur | - |
Pairs with non-Balkan languages
bul | mkd | ron | rup | sqi | ell | hbs | slv | tur | |
---|---|---|---|---|---|---|---|---|---|
el | bg-el | ||||||||
ru | bg-ru | hbs-rus | |||||||
en | bg-en | mk-en | en-sq | ell-eng | sh-en | tr-en | |||
it | ro-it | sl-it | |||||||
spa | slv-spa | ||||||||
pol | slv-pol | ||||||||
eo | eo-bg | eo-el | |||||||
fr | fr-ro | ||||||||
ca | ca-ro | ||||||||
es | es-ro | ||||||||
cs | cs-sl | ||||||||
kir | tur-kir | ||||||||
tat | tur-tat | ||||||||
uzb | tur-uzb | ||||||||
aze | tur-aze | ||||||||
cv | cv-tr |
Existing
Monolingual
Language | Module | Paradigms | Lemmata | Coverage (SETimes) | Coverage (Wikipedia) |
---|---|---|---|---|---|
Bulgarian | Macedonian and Bulgarian | 305 | 7873 | 88.1% | 77.15% |
Macedonian | Macedonian and Bulgarian | 225 | 8094 | 92.1% | |
Romanian | Spanish and Romanian | 997 | 18719 | 89.7% | 83.62% |
Aromanian | Incubator | 17 | 28 | - | |
Albanian | Incubator | 127 | 3302 | 80.2% | 65.62% |
Greek | Incubator | 377 | 859 | 49.4% | 49.75% |
Serbo-Croatian | Incubator | 85 | 660 | - | |
Slovenian | Incubator | 1128 | 20385 | - | |
Turkish | (external: TRMorph) | - | 37101 |
Languages missing: Roma