Difference between revisions of "Bengali and English/Final report"
| Line 43: | Line 43: | ||
==Future work== |
==Future work== |
||
There are a lot of works to be done. Currently we are focusing completely on the transfer system. There are several issues like verb negation that is not so easy to resolve. We have to complete that and in the meantime enrich the bilingual dictionary. We also have a plan for building a user interface for dictionary entries. But the transfer system is on the prime focus. |
|||
==Thanks== |
==Thanks== |
||
Revision as of 14:56, 26 August 2011
Description
Monodix
The Bengali monodix is now in quite a good state with around 80% coverage of Bengali wiki. There are about 8230 lemmas among which 3594 are nouns, 1766 proper nouns, 1620 adjectives, 473 adverbs and 777 other lemmas. We are looking forward to increase the coverage alongside completing the transfer rules.
Bidix
The bidix currently consist of 7446 entries. Though this is quite a big number with respect to the monodix, some common usual words are still not there. But it will be covered gradually with the work of transfer rules. And the English lemmas provided in the bidix are not all exist in the English monodix. That also need to be updated. Currently there are 3444 nouns, 1686 proper nouns, 1384 adjectives, 1243 other lemmas.
Constraint Grammar and Transfer rules
We've just beginning to build up the skeleton for the transfer system. This is a complex task as the two languages are not closely related at all. There are several issues with ordering pos like verb-object ordering. Again there is no preposition in Bengali, it comes after the nominal. These issues are resolved with a primary approach. The negation of verbs are yet not handled. That'd be the most challenging part of the transfer system I guess. A good look of what sort of cases are handled can be seen from the regression tests.
Statistics
- Dictionaries
apertium-bn-en.bn.dix: 8,230apertium-bn-en.en-bn.dix:7,495
- Coverage
- Bengali Wikipedia: 80.59% +/- 1.7878%
- Prothom Alo:
- Rules
apertium-bn-en.en-bn.t1x: 42apertium-bn-en.en-bn.t2x: 16apertium-bn-en.en-bn.t3x: 2
- Error rate
| File | Num. Words | % OOV | WER (Sur) | PER (Sur) | WER (Lem) | PER (Lem) |
|---|---|---|---|---|---|---|
prothom-alo |
- | - |
Future work
There are a lot of works to be done. Currently we are focusing completely on the transfer system. There are several issues like verb negation that is not so easy to resolve. We have to complete that and in the meantime enrich the bilingual dictionary. We also have a plan for building a user interface for dictionary entries. But the transfer system is on the prime focus.
