Difference between revisions of "Bengali and English/Final report"

From Apertium
Jump to navigation Jump to search
Line 43: Line 43:
   
 
==Future work==
 
==Future work==
  +
There are a lot of works to be done. Currently we are focusing completely on the transfer system. There are several issues like verb negation that is not so easy to resolve. We have to complete that and in the meantime enrich the bilingual dictionary. We also have a plan for building a user interface for dictionary entries. But the transfer system is on the prime focus.
 
   
 
==Thanks==
 
==Thanks==

Revision as of 14:56, 26 August 2011

Description

Monodix

The Bengali monodix is now in quite a good state with around 80% coverage of Bengali wiki. There are about 8230 lemmas among which 3594 are nouns, 1766 proper nouns, 1620 adjectives, 473 adverbs and 777 other lemmas. We are looking forward to increase the coverage alongside completing the transfer rules.

Bidix

The bidix currently consist of 7446 entries. Though this is quite a big number with respect to the monodix, some common usual words are still not there. But it will be covered gradually with the work of transfer rules. And the English lemmas provided in the bidix are not all exist in the English monodix. That also need to be updated. Currently there are 3444 nouns, 1686 proper nouns, 1384 adjectives, 1243 other lemmas.

Constraint Grammar and Transfer rules

We've just beginning to build up the skeleton for the transfer system. This is a complex task as the two languages are not closely related at all. There are several issues with ordering pos like verb-object ordering. Again there is no preposition in Bengali, it comes after the nominal. These issues are resolved with a primary approach. The negation of verbs are yet not handled. That'd be the most challenging part of the transfer system I guess. A good look of what sort of cases are handled can be seen from the regression tests.

Statistics

Dictionaries
  • apertium-bn-en.bn.dix: 8,230
  • apertium-bn-en.en-bn.dix:7,495


Coverage
  • Bengali Wikipedia: 80.59% +/- 1.7878%
  • Prothom Alo:


Rules
  • apertium-bn-en.en-bn.t1x: 42
  • apertium-bn-en.en-bn.t2x: 16
  • apertium-bn-en.en-bn.t3x: 2


Error rate
File Num. Words % OOV WER (Sur) PER (Sur) WER (Lem) PER (Lem)
prothom-alo - -

Future work

There are a lot of works to be done. Currently we are focusing completely on the transfer system. There are several issues like verb negation that is not so easy to resolve. We have to complete that and in the meantime enrich the bilingual dictionary. We also have a plan for building a user interface for dictionary entries. But the transfer system is on the prime focus.

Thanks

See Also