Difference between revisions of "Maltese and Arabic/Work plan"

From Apertium
Jump to navigation Jump to search
Line 33: Line 33:
 
| 10 || <s>23/07&mdash;29/07</s> || 80% || 80.9%, 80.2% || {{tag|v}} || - || - || - || Testvoc
 
| 10 || <s>23/07&mdash;29/07</s> || 80% || 80.9%, 80.2% || {{tag|v}} || - || - || - || Testvoc
 
|-
 
|-
| 11 || 30/07&mdash;05/08 || 80% || - || - || - || - || - || Testvoc
+
| 11 || <s>30/07&mdash;05/08</s> || 80% || 81.2%, 80.5% || - || - || - || - || Testvoc
 
|-
 
|-
 
| 12 || 06/08&mdash;12/08 || 80% || - || ''all categories clean'' || 500 words || ? || - || '''Final evaluation'''. Tidying up, releasing
 
| 12 || 06/08&mdash;12/08 || 80% || - || ''all categories clean'' || 500 words || ? || - || '''Final evaluation'''. Tidying up, releasing

Revision as of 10:49, 8 August 2012

This is a workplan for development efforts for the Maltese and Arabic translator in Google Summer of Code 2012.

  • Bidix-trimmed coverage means the coverage of the morphological analyser after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary (but omissions leading to generation errors do not change the trimmed coverage)
  • Testvoc for a category means that the category is testvoc clean, in both translation directions.
  • Evaluation is taking words and performing an evaluation for post-edition word error rate (WER). The output for those words should be clean, ie. no #/@, and no (or as few as possible) *, for all WER tests.
    • Note on the WER results: both tests use references that are post-edited from the respective MT outputs, but the texts were used in apertium development, so unrestricted texts would probably look quite different. Texts are in SVN in apertium-mt-ar/dev/story/


Week Dates B-trimmed Cov. Goal B-trimmed Cov. Reached (news, wp) Testvoc Evaluation WER Reached (Google WER) Notes
0 23/04—20/05 45% 68.6%, 68.1% <sent> <cm> <ij> 500 words 3.17 % (47.44 %) Preliminary evaluation. Translate the story total coverage and without diagnostics. Get a baseline WER. Aim to get the two mt verb scripts merged.
1 21/05—27/05 50% 74.2%, 73.8% <num> <pr> - - - Basic numerals, and prepositions should be testvoc clean. Maltese verb scripts merged.
2 28/05—03/06 53% 75.3%, 74.5% <cnjcoo> <cnjadv> <cnjsub> - - - Create ar verb script based on mt, add ar open-class words according to frequency
3 04/06—10/06 59% 75.3%, 74.4% <adv> 200 words 8.70 % (20.94 %) Continue adding open class words to ar (adding to bidix/mt as you go)
4 11/06—17/06 63% 76.0%, 75.1% <prn> <det> - - - Monodix completion; closed classes (apart from verb-attached pronouns) should be testvoc clean.
5 18/06—24/06 68% 79.0%, 78.3% <adj> - - - Bidix expansion; bidix adjectives should be testvoc clean.
6 25/06—01/07 70% 79.1%, 78.4% <n> <np> 500 words 23.11% (33.53 %) Midterm evaluation. Bidix expansion, multiwords.
7 02/07—08/07 73% 79.4%, 78.6% - - - - Transfer
8 09/07—15/07 75% 79.5%, 78.8% - - - - Transfer, corpus testvoc
9 16/07—22/07 77% 80.5%, 80.0% - 200 words 17.28% (35.89 %) Disambiguation, retrain tagger
10 23/07—29/07 80% 80.9%, 80.2% <v> - - - Testvoc
11 30/07—05/08 80% 81.2%, 80.5% - - - - Testvoc
12 06/08—12/08 80% - all categories clean 500 words ? - Final evaluation. Tidying up, releasing