Bengali and English/Final report

Description

Monodix

The Bengali monodix is now in quite a good state with around 80% coverage of Bengali wiki. There are about 8230 lemmas among which 3594 are nouns, 1766 proper nouns, 1620 adjectives, 473 adverbs and 777 other lemmas. We are looking forward to increase the coverage alongside completing the transfer rules.

Bidix

The bidix currently consist of 7446 entries. Though this is quite a big number with respect to the monodix, some common usual words are still not there. But it will be covered gradually with the work of transfer rules. And the English lemmas provided in the bidix are not all exist in the English monodix. That also need to be updated. Currently there are 3444 nouns, 1686 proper nouns, 1384 adjectives, 1243 other lemmas.

Constraint Grammar and Transfer rules

We've just beginning to build up the skeleton for the transfer system. This is a complex task as the two languages are not closely related at all. There are several issues with ordering pos like verb-object ordering. Again there is no preposition in Bengali, it comes after the nominal. These issues are resolved with a primary approach. The negation of verbs are yet not handled. That'd be the most challenging part of the transfer system I guess. A good look of what sort of cases are handled can be seen from the regression tests.

Statistics

Dictionaries

• apertium-bn-en.bn.dix: 8,230
• apertium-bn-en.en-bn.dix:7,495

Coverage

• Bengali Wikipedia: 80.59% +/- 1.7878%
• Prothom Alo:

Rules

• apertium-bn-en.en-bn.t1x: 42
• apertium-bn-en.en-bn.t2x: 16
• apertium-bn-en.en-bn.t3x: 2

Error rate

File	Num. Words	% OOV	WER (Sur)	PER (Sur)	WER (Lem)	PER (Lem)
prothom-alo					-	-