Bengali and English/Final report - Revision history

Ragib06: /* Description */

2011-08-26T23:00:46Z

Description

Ragib06: /* Description */

2011-08-26T17:53:37Z

Description

Ragib06: /* Description */

2011-08-26T15:22:04Z

Description

Ragib06: /* Description */

2011-08-26T15:19:13Z

Description

Ragib06: /* See Also */

2011-08-26T15:08:07Z

Ragib06: /* See Also */

2011-08-26T15:04:32Z

Ragib06: /* Thanks */

2011-08-26T15:01:53Z

Thanks

Ragib06: /* Future work */

2011-08-26T14:56:35Z

Future work

Ragib06: /* Statistics */

2011-08-26T14:50:06Z

Statistics

Ragib06: /* Transfer rules */

2011-08-26T14:46:38Z

Transfer rules

← Older revision		Revision as of 23:00, 26 August 2011
Line 2:		Line 2:

	==Description==		==Description==
	Our primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. ~~previously~~ the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. ~~But there~~ are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its ~~basic~~ state and we are looking forward to complete the task as soon as possible. The technical details are provided below. Though we couldn't complete whatever we ~~dreamed~~, I really enjoyed being in such a kind of team and working together ~~for~~ throughout the summer.		Our primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. Previously the coverage was around 68%. In the meantime, the bilingual dictionary was also being enriched with new entries. There are some entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its primitive state and we are looking forward to complete the task as soon as possible. The technical details are provided below. Though we couldn't complete whatever we dreamt, I really enjoyed being in such a kind of team and working together throughout the summer.

← Older revision		Revision as of 17:53, 26 August 2011
Line 2:		Line 2:

	==Description==		==Description==
	Ou primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. previously the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. But there are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its basic state and we are looking forward to complete the task as soon as possible. The technical details are provided below. Though we couldn't complete whatever we dreamed, I really enjoyed being in such a kind of team and working together for throughout the summer.		Our primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. previously the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. But there are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its basic state and we are looking forward to complete the task as soon as possible. The technical details are provided below. Though we couldn't complete whatever we dreamed, I really enjoyed being in such a kind of team and working together for throughout the summer.

← Older revision		Revision as of 15:22, 26 August 2011
Line 2:		Line 2:

	==Description==		==Description==
	Ou primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. previously the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. But there are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its basic state and we are looking forward to complete the task as soon as possible. The technical details are provided below. I really enjoyed being in a such a kind of team and working together for throughout the summer.		Ou primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. previously the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. But there are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its basic state and we are looking forward to complete the task as soon as possible. The technical details are provided below. Though we couldn't complete whatever we dreamed, I really enjoyed being in such a kind of team and working together for throughout the summer.

@@ Line 2: / Line 2: @@
 ==Description==
+Ou primary goal was to achieve at least 80% coverage of Benglai wiki for the monodix. We completed that in the midterm. It was more than 3000 entries required to reach the goal. previously the coverage was around 68%. In the meantime, the bilingual dictionary also being enriched with new entries. But there are entries that need to be updated to the English monodix section. After the midterm, we focused on the transfer system. It was kind of fresh start as there were only a few rules available. The transfer system for the bn-en pair is quite challenging as the languages are not closely related. In fact, there are several complex issues that arise when translating. We had to deal with that and unfortunately with very few resources available. Currently the transfer system is in its basic state and we are looking forward to complete the task as soon as possible. The technical details are provided below. I really enjoyed being in a such a kind of team and working together for throughout the summer.
 ===Monodix===

@@ Line 50: / Line 50: @@
 ==See Also==
-* [[User:Ragib06/Application]] -- Original application
+* [http://wiki.apertium.org/wiki/User:Ragib06/Application2011 Original Proposal]
+* [http://www.mt-archive.info/FreeRBMT-2009-Faridee.pdf Development of a morphological analyzer for Bengali]
 [[Category:Bengali and English]]

@@ Line 46: / Line 46: @@
 ==Thanks==
+Though the work is not complete, I have to thank Zaher for his tremendous support throughout the GSoC timeline. And with the small resource for Bengali he actually done a great job to come up with this state. I'm really grateful to him for whatever I've done here. And of course, Francis helped a great deal to make things work the right way. I really learned a lot from these guys over the whole GSoC period. And I'll be really happy to work with them in future :)
 ==See Also==

@@ Line 43: / Line 43: @@
 ==Future work==
+There are a lot of works to be done. Currently we are focusing completely on the transfer system. There are several issues like verb negation that is not so easy to resolve. We have to complete that and in the meantime enrich the bilingual dictionary. We also have a plan for building a user interface for dictionary entries. But the transfer system is on the prime focus.
 ==Thanks==

@@ Line 24: / Line 24: @@
 * Bengali Wikipedia: 80.59% +/- 1.7878%
 * Prothom Alo:
 ; Rules
@@ Line 30: / Line 31: @@
 * <code>apertium-bn-en.en-bn.t2x</code>: 16
 * <code>apertium-bn-en.en-bn.t3x</code>: 2
 ; Error rate

@@ Line 9: / Line 9: @@
 The bidix currently consist of 7446 entries. Though this is quite a big number with respect to the monodix, some common usual words are still not there. But it will be covered gradually with the work of transfer rules. And the English lemmas provided in the bidix are not all exist in the English monodix. That also need to be updated. Currently there are 3444 nouns, 1686 proper nouns, 1384 adjectives, 1243 other lemmas.
-===Transfer rules===
+===Constraint Grammar and Transfer rules===
+We've just beginning to build up the skeleton for the transfer system. This is a complex task as the two languages are not closely related at all. There are several issues with ordering pos like verb-object ordering. Again there is no preposition in Bengali, it comes after the nominal. These issues are resolved with a primary approach. The negation of verbs are yet not handled. That'd be the most challenging part of the transfer system I guess. A good look of what sort of cases are handled can be seen from the [http://wiki.apertium.org/wiki/Bengali_and_English/Regression_tests regression tests].
 ==Statistics==