Difference between revisions of "Indic languages"
| Line 75: | Line 75: | ||
* Dardic: [[Pahayi]], [[Khowar]], [[Kohistani]], [[Shina language]], [[Kashiri]] |
* Dardic: [[Pahayi]], [[Khowar]], [[Kohistani]], [[Shina language]], [[Kashiri]] |
||
* Northern Zone: |
* Northern Zone: |
||
** |
**Central Pahari |
||
***[[Garhwali]], [[Kumauni]] |
***[[Garhwali]], [[Kumauni]] |
||
**Eastern Pahari |
**Eastern Pahari |
||
| Line 82: | Line 82: | ||
**Dogri-Kangri |
**Dogri-Kangri |
||
***[[Dogri]], [[Kangri]], [[Mandeali]], etc. |
***[[Dogri]], [[Kangri]], [[Mandeali]], etc. |
||
* Western Zone: |
* Western Zone: [[Gujarati]], [[Bhil]], [[Khandeshi]], [[Domari-Romani]] |
||
** Rajasthani |
** Rajasthani |
||
*** [[Marwari]], [[Rajasthani]] |
*** [[Marwari]], [[Rajasthani]] |
||
**[[Gujarati]] |
|||
**[[Bhil]] |
|||
**[[Khandeshi]] |
|||
**[[Domari-Romani]] |
|||
* [[Hindi]] |
* [[Hindi]] |
||
* Southern Zone: [[Marathi]], [[Konkani]] |
* Southern Zone: [[Marathi]], [[Konkani]] |
||
** Insular Indic: [[Sinhalese]], [[Maldivian]] |
** Insular Indic: [[Sinhalese]], [[Maldivian]] |
||
* Eastern Zone: |
* Eastern Zone: [[Bengali]], [[Oriya]], [[Tharu]] |
||
** Bihari |
** Bihari |
||
*** [[Bhojpuri]], [[Maithili]], etc. |
*** [[Bhojpuri]], [[Maithili]], etc. |
||
** [[Bengali]] |
|||
** [[Oriya]] |
|||
** [[Tharu]] |
|||
* [[Sanskrit]] |
* [[Sanskrit]] |
||
Revision as of 18:15, 22 November 2013
The Indic languages include Hindi, Urdu, Bengali, Sanskrit, and several other languages. These languages are the dominant language family of the Indian subcontinent. The number of people that speak an Indic language is upwards of 900,000,000.
The master plan involves generating independent finite-state transducers for each language, and then making individual dictionaries and transfer rules for every pair. The current status of these goals is listed below.
Status
The ultimate goal is to have multi-purposable transducers for a variety of Indic languages. These can then be paired for X→Y translation with the addition of a CG for language X and transfer rules / dictionary for the pair X→Y. Below is listed development progress for each language's transducers and dictionary pairs.
Transducers
Once a transducer has ~80% coverage on a range of medium-large corpora we can say it is "working". Over 90% and it can be considered to be "production".
| name | Language | ISO 639 | formalism | state | stems | coverage | location | primary authors | |
|---|---|---|---|---|---|---|---|---|---|
| -2 | -3 | ||||||||
apertium-hin
|
Hindi | hi
|
hin
|
HFST (lexc+twol) | production | 37,833 | - | apertium-hin (languages) | Nikant, Abu Zaher Md. Faridee, Fran |
apertium-urd
|
Urdu | ur
|
urd
|
HFST (lexc+twol) | production | 14,943 | - | apertium-urd (languages) | - |
apertium-ben
|
Bengali | bn
|
ben
|
HFST (lexc+twol) | production | 8,230 | - | apertium-ben (languages) | Abu Zaher Md. Faridee |
apertium-san
|
Sanskrit | sa
|
san
|
HFST (lexc+twol) | production | 123,373 | - | apertium-san (languages) | Amba Kulkarni |
Indic Language Classification
- Dardic: Pahayi, Khowar, Kohistani, Shina language, Kashiri
- Northern Zone:
- North-Western Zone: Punjabi, Lahnda, Sindhi
- Western Zone: Gujarati, Bhil, Khandeshi, Domari-Romani
- Rajasthani
- Hindi
- Southern Zone: Marathi, Konkani
- Eastern Zone: Bengali, Oriya, Tharu
- Sanskrit
Indic-Indic pairs
| hin | ben | urd | san | |
|---|---|---|---|---|
| hin | - | |||
| ben | bn-hi | - | ||
| urd | ur-hi | - | ||
| san | - |
Pairs with non-Indic languages
| eng | as | mr | pa | fa | |
|---|---|---|---|---|---|
| hin | eng-hin | as-hi | mr-hi | pa-hi | |
| ben | bn-en | ||||
| urd | ur-pa | ur-fa | |||
| san |
Tagset
Rough guide to tagsets in various Indic language transducers, with an eye to keeping stuff that is basically the same tagged the same. In the following table, A stands for Apertium and T stands for TRmorph (See also the general tagset list).
| Phenomenon | Morphology | Description | Tag(s) | Language(s) | Notes |
|---|---|---|---|---|---|
| Part of speech | |||||
| Noun | <n> |
||||
