Maltese and Arabic/Work plan

This is a workplan for development efforts for the Maltese and Arabic translator in Google Summer of Code 2012.

• Bidix-trimmed coverage means the coverage of the morphological analyser after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary (but omissions leading to generation errors do not change the trimmed coverage)
• Testvoc for a category means that the category is testvoc clean, in both translation directions.
• Evaluation is taking $n$ words and performing an evaluation for post-edition word error rate (WER). The output for those $n$ words should be clean, ie. no #/@, and no (or as few as possible) *, for all WER tests.
  • Note on the WER results: both tests use references that are post-edited from the respective MT outputs, but the texts were used in apertium development, so unrestricted texts would probably look quite different. Texts are in SVN in apertium-mt-ar/dev/story/

Week	Dates	B-trimmed Cov. Goal	B-trimmed Cov. Reached (news, wp)	Testvoc	Evaluation	WER Reached	(Google WER)	Notes
0	23/04—20/05	45%	68.6%, 68.1%	<sent> <cm> <ij>	500 words	3.17 %	(47.44 %)	Preliminary evaluation. Translate the story total coverage and without diagnostics. Get a baseline WER. Aim to get the two mt verb scripts merged.
1	21/05—27/05	50%	74.2%, 73.8%	<num> <pr>	-	-	-	Basic numerals, and prepositions should be testvoc clean. Maltese verb scripts merged.
2	28/05—03/06	53%	75.3%, 74.5%	<cnjcoo> <cnjadv> <cnjsub>	-	-	-	Create ar verb script based on mt, add ar open-class words according to frequency
3	04/06—10/06	59%	75.3%, 74.4%	<adv>	200 words	8.70 %	(20.94 %)	Continue adding open class words to ar (adding to bidix/mt as you go)
4	11/06—17/06	63%	76.0%, 75.1%	<prn> <det>	-	-	-	Monodix completion; closed classes (apart from verb-attached pronouns) should be testvoc clean.
5	18/06—24/06	68%	79.0%, 78.3%	<adj>	-	-	-	Bidix expansion; bidix adjectives should be testvoc clean.
6	25/06—01/07	70%	79.1%, 78.4%	<n> <np>	500 words	23.11%	(33.53 %)	Midterm evaluation. Bidix expansion, multiwords.
7	02/07—08/07	73%	79.4%, 78.6%	-	-	-	-	Transfer
8	09/07—15/07	75%	79.5%, 78.8%	-	-	-	-	Transfer, corpus testvoc
9	16/07—22/07	77%	80.5%, 80.0%	-	200 words	17.28%	(35.89 %)	Disambiguation, retrain tagger
10	23/07—29/07	80%	80.9%, 80.2%	<v>	-	-	-	Testvoc
11	30/07—05/08	80%	81.2%, 80.5%	-	-	-	-	Testvoc
12	06/08—12/08	80%	82.0%, 80.9%	all categories clean	500 words	?	-	Final evaluation. Tidying up, releasing