Difference between revisions of "Maltese and Arabic/Work plan"
Jump to navigation
Jump to search
Line 23: | Line 23: | ||
| 5 || <s>18/06—24/06</s> || 68% || 79.0%, 78.3% || {{tag|adj}} || - || - || - || Bidix expansion; bidix adjectives should be testvoc clean. |
| 5 || <s>18/06—24/06</s> || 68% || 79.0%, 78.3% || {{tag|adj}} || - || - || - || Bidix expansion; bidix adjectives should be testvoc clean. |
||
|- |
|- |
||
| 6 || <s>25/06—01/07</s> || 70% || 79.1%, 78.4% || {{tag|n}} {{tag|np}} || 500 words || 23.11% || (33.53 %) || '''Midterm evaluation'''. Bidix expansion, multiwords. |
| 6 || <s>25/06—01/07</s> || 70% || 79.1%, 78.4% || {{tag|n}} {{tag|np}} || 500 words || 23.11 % || (33.53 %) || '''Midterm evaluation'''. Bidix expansion, multiwords. |
||
|- |
|- |
||
| 7 || <s>02/07—08/07</s> || 73% || 79.4%, 78.6% || - || - || - || - || Transfer |
| 7 || <s>02/07—08/07</s> || 73% || 79.4%, 78.6% || - || - || - || - || Transfer |
||
Line 29: | Line 29: | ||
| 8 || <s>09/07—15/07</s> || 75% || 79.5%, 78.8% || - || - || - || - || Transfer, corpus testvoc |
| 8 || <s>09/07—15/07</s> || 75% || 79.5%, 78.8% || - || - || - || - || Transfer, corpus testvoc |
||
|- |
|- |
||
| 9 || <s>16/07—22/07</s> || 77% || 80.5%, 80.0% || - || 200 words || 17.28% || (35.89 %) || Disambiguation, retrain tagger |
| 9 || <s>16/07—22/07</s> || 77% || 80.5%, 80.0% || - || 200 words || 17.28 % || (35.89 %) || Disambiguation, retrain tagger |
||
|- |
|- |
||
| 10 || <s>23/07—29/07</s> || 80% || 80.9%, 80.2% || {{tag|v}} || - || - || - || Testvoc |
| 10 || <s>23/07—29/07</s> || 80% || 80.9%, 80.2% || {{tag|v}} || - || - || - || Testvoc |
||
Line 35: | Line 35: | ||
| 11 || <s>30/07—05/08</s> || 80% || 81.2%, 80.5% || - || - || - || - || Testvoc |
| 11 || <s>30/07—05/08</s> || 80% || 81.2%, 80.5% || - || - || - || - || Testvoc |
||
|- |
|- |
||
| 12 || <s>06/08—12/08</s> || 80% || 82.0%, 80.9% || ''all categories clean'' || 500 words || |
| 12 || <s>06/08—12/08</s> || 80% || 82.0%, 80.9% || ''all categories clean'' || 500 words || 21.34 % || (39.00 %) || '''Final evaluation'''. Tidying up, releasing |
||
|- |
|- |
||
|} |
|} |
Revision as of 05:32, 28 August 2012
This is a workplan for development efforts for the Maltese and Arabic translator in Google Summer of Code 2012.
- Bidix-trimmed coverage means the coverage of the morphological analyser after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary (but omissions leading to generation errors do not change the trimmed coverage)
- Testvoc for a category means that the category is testvoc clean, in both translation directions.
- Evaluation is taking words and performing an evaluation for post-edition word error rate (WER). The output for those words should be clean, ie. no #/@, and no (or as few as possible) *, for all WER tests.
- Note on the WER results: both tests use references that are post-edited from the respective MT outputs, but the texts were used in apertium development, so unrestricted texts would probably look quite different. Texts are in SVN in apertium-mt-ar/dev/story/
Week | Dates | B-trimmed Cov. Goal | B-trimmed Cov. Reached (news, wp) | Testvoc | Evaluation | WER Reached | (Google WER) | Notes |
---|---|---|---|---|---|---|---|---|
0 | 45% | 68.6%, 68.1% | <sent> <cm> <ij> |
500 words | 3.17 % | (47.44 %) | Preliminary evaluation. Translate the story total coverage and without diagnostics. Get a baseline WER. Aim to get the two mt verb scripts merged. | |
1 | 50% | 74.2%, 73.8% | <num> <pr> |
- | - | - | Basic numerals, and prepositions should be testvoc clean. Maltese verb scripts merged. | |
2 | 53% | 75.3%, 74.5% | <cnjcoo> <cnjadv> <cnjsub> |
- | - | - | Create ar verb script based on mt, add ar open-class words according to frequency | |
3 | 59% | 75.3%, 74.4% | <adv> |
200 words | 8.70 % | (20.94 %) | Continue adding open class words to ar (adding to bidix/mt as you go) | |
4 | 63% | 76.0%, 75.1% | <prn> <det> |
- | - | - | Monodix completion; closed classes (apart from verb-attached pronouns) should be testvoc clean. | |
5 | 68% | 79.0%, 78.3% | <adj> |
- | - | - | Bidix expansion; bidix adjectives should be testvoc clean. | |
6 | 70% | 79.1%, 78.4% | <n> <np> |
500 words | 23.11 % | (33.53 %) | Midterm evaluation. Bidix expansion, multiwords. | |
7 | 73% | 79.4%, 78.6% | - | - | - | - | Transfer | |
8 | 75% | 79.5%, 78.8% | - | - | - | - | Transfer, corpus testvoc | |
9 | 77% | 80.5%, 80.0% | - | 200 words | 17.28 % | (35.89 %) | Disambiguation, retrain tagger | |
10 | 80% | 80.9%, 80.2% | <v> |
- | - | - | Testvoc | |
11 | 80% | 81.2%, 80.5% | - | - | - | - | Testvoc | |
12 | 80% | 82.0%, 80.9% | all categories clean | 500 words | 21.34 % | (39.00 %) | Final evaluation. Tidying up, releasing |