Difference between revisions of "Kazakh and Tatar/Work plan"

From Apertium
Jump to navigation Jump to search
Line 1: Line 1:
 
This is a workplan for development efforts for [[Kazakh and Tatar]] translator in [[Google Summer of Code]] 2012.
 
This is a workplan for development efforts for [[Kazakh and Tatar]] translator in [[Google Summer of Code]] 2012.
   
* Trimmed coverage means the coverage of both of the morphological analysers after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary.
+
* Bidix-trimmed coverage means the coverage of the morphological analyser after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary (but omissions leading to generation errors do not change the trimmed coverage)
 
* Testvoc for a category means that the category is [[testvoc]] clean, in both translation directions.
 
* Testvoc for a category means that the category is [[testvoc]] clean, in both translation directions.
 
* Evaluation is taking <math>n</math> words and performing an [[evaluation]] for post-edition word error rate (WER). The output for those <math>n</math> words should be clean.
 
* Evaluation is taking <math>n</math> words and performing an [[evaluation]] for post-edition word error rate (WER). The output for those <math>n</math> words should be clean.
  +
  +
("news" corpus is <code>kaz.rferl.2010.xml</code>, wp &mdash; <code>kaz.fixed.wikipedia.2010_100k-sentences.txt.bz2<code> )
   
 
{|class=wikitable
 
{|class=wikitable
 
|-
 
|-
! Week !! Dates !! Trimmed coverage !! Testvoc !! Evaluation !! Notes
+
! Week !! Dates !! B-trimmed Cov. Goal !! B-trimmed Cov. Reached (news, wp) !! Testvoc !! Evaluation !! Notes
 
|-
 
|-
| 0 || 23/04&mdash;21/05 || 45% || {{tag|postadv}} {{tag|ij}} || 500 words || '''Preliminary evaluation'''. Translate the story total coverage and without diagnostics (in both directions). Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
+
| 0 || <s>23/04&mdash;21/05</s> || 45% || ?.?, ?.? || {{tag|postadv}} {{tag|ij}} || 500 words || '''Preliminary evaluation'''. Translate the story total coverage and without diagnostics (in both directions). Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
 
|-
 
|-
| 1 || 21/05&mdash;27/05 || 50% || {{tag|num}} {{tag|post}} || - || Basic numerals, and postpositions should be clean.
+
| 1 || <s>21/05&mdash;27/05</s> || 50% || ?.?, ?.? || {{tag|num}} {{tag|post}} || - || Basic numerals, and postpositions should be clean.
 
|-
 
|-
| 2 || 28/05&mdash;03/06 || 53% || {{tag|cnjcoo}} {{tag|cnjadv}} {{tag|cnjsub}} || - ||
+
| 2 || <s>28/05&mdash;03/06</s> || 53% || - || {{tag|cnjcoo}} {{tag|cnjadv}} {{tag|cnjsub}} || - ||
 
|-
 
|-
| 3 || 04/06&mdash;10/06 || 59% || {{tag|adv}} {{tag|abbr}} || 200 words || Work on disambiguation.
+
| 3 || 04/06&mdash;10/06 || 59% || - || {{tag|adv}} {{tag|abbr}} || 200 words || Work on disambiguation.
 
|-
 
|-
| 4 || 11/06&mdash;17/06 || 63% || {{tag|prn}} {{tag|det}} || - ||
+
| 4 || 11/06&mdash;17/06 || 63% || - || {{tag|prn}} {{tag|det}} || - ||
 
|-
 
|-
| 5 || 18/06&mdash;24/06 || 68% || {{tag|adj}} {{tag|adj><advl}} || - || Adjectives with attributive and adverbial function should be clean. Numerals + affixes should have their phonology solved.
+
| 5 || 18/06&mdash;24/06 || 68% || - || {{tag|adj}} {{tag|adj><advl}} || - || Adjectives with attributive and adverbial function should be clean. Numerals + affixes should have their phonology solved.
 
|-
 
|-
| 6 || 25/06&mdash;01/07 || 70% || {{tag|n}} {{tag|num><subst}} {{tag|np}} {{tag|adj><subst}} || 500 words || '''Midterm evaluation'''. Work on disambiguation.
+
| 6 || 25/06&mdash;01/07 || 70% || - || {{tag|n}} {{tag|num><subst}} {{tag|np}} {{tag|adj><subst}} || 500 words || '''Midterm evaluation'''. Work on disambiguation.
 
|-
 
|-
| 7 || 02/07&mdash;08/07 || 73% || - || - ||
+
| 7 || 02/07&mdash;08/07 || 73% || - || - || - ||
 
|-
 
|-
| 8 || 09/07&mdash;15/07 || 75% || - || - ||
+
| 8 || 09/07&mdash;15/07 || 75% || || - || - ||
 
|-
 
|-
| 9 || 16/07&mdash;22/07 || 77% || - || 200 words || Work on disambiguation.
+
| 9 || 16/07&mdash;22/07 || 77% || || - || 200 words || Work on disambiguation.
 
|-
 
|-
| 10 || 23/07&mdash;29/07 || 80% || {{tag|v}} || - ||
+
| 10 || 23/07&mdash;29/07 || 80% || || {{tag|v}} || - ||
 
|-
 
|-
| 11 || 30/07&mdash;05/08 || 80% || - || - || Work on disambiguation.
+
| 11 || 30/07&mdash;05/08 || 80% || || - || - || Work on disambiguation.
 
|-
 
|-
| 12 || 06/08&mdash;12/08 || 80% || ''all categories clean'' || 500 words || '''Final evaluation'''. Tidying up, releasing
+
| 12 || 06/08&mdash;12/08 || 80% || || ''all categories clean'' || 500 words || '''Final evaluation'''. Tidying up, releasing
 
|-
 
|-
 
|}
 
|}

Revision as of 20:54, 5 June 2012

This is a workplan for development efforts for Kazakh and Tatar translator in Google Summer of Code 2012.

  • Bidix-trimmed coverage means the coverage of the morphological analyser after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary (but omissions leading to generation errors do not change the trimmed coverage)
  • Testvoc for a category means that the category is testvoc clean, in both translation directions.
  • Evaluation is taking words and performing an evaluation for post-edition word error rate (WER). The output for those words should be clean.

("news" corpus is kaz.rferl.2010.xml, wp — kaz.fixed.wikipedia.2010_100k-sentences.txt.bz2 )

Week Dates B-trimmed Cov. Goal B-trimmed Cov. Reached (news, wp) Testvoc Evaluation Notes
0 23/04—21/05 45% ?.?, ?.? <postadv> <ij> 500 words Preliminary evaluation. Translate the story total coverage and without diagnostics (in both directions). Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
1 21/05—27/05 50% ?.?, ?.? <num> <post> - Basic numerals, and postpositions should be clean.
2 28/05—03/06 53% - <cnjcoo> <cnjadv> <cnjsub> -
3 04/06—10/06 59% - <adv> <abbr> 200 words Work on disambiguation.
4 11/06—17/06 63% - <prn> <det> -
5 18/06—24/06 68% - <adj> <adj><advl> - Adjectives with attributive and adverbial function should be clean. Numerals + affixes should have their phonology solved.
6 25/06—01/07 70% - <n> <num><subst> <np> <adj><subst> 500 words Midterm evaluation. Work on disambiguation.
7 02/07—08/07 73% - - -
8 09/07—15/07 75% - -
9 16/07—22/07 77% - 200 words Work on disambiguation.
10 23/07—29/07 80% <v> -
11 30/07—05/08 80% - - Work on disambiguation.
12 06/08—12/08 80% all categories clean 500 words Final evaluation. Tidying up, releasing