Difference between revisions of "Indonesian and Malaysian/Work plan"

From Apertium
Jump to navigation Jump to search
Line 1: Line 1:
  ⚫
This is a workplan for development efforts for the [[Indonesian and Malaysian]] translator in [[Google Summer of Code]] 2012.
−
<!--
  
−
==Work plan==
  
−  
⚫
This is a draft workplan for development of the Indonesian and Malaysian translator.
 
−  
−
* Trimmed coverage means the coverage of both of the morphological analysers after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary.
  
−
* Testvoc for a category means that the category is [[testvoc]] clean, in both translation directions.
  
−
* Evaluation is taking <math>n</math> words and performing an [[evaluation]] for post-edition word error rate (WER). The output for those <math>n</math> words should be clean.
  
   
 
{|class=wikitable
  
{|class=wikitable
 
|-
  
|-
−
! Week !! Dates !! Trimmed coverage !! Testvoc !! Evaluation !! Notes
 +
! Week !! Dates !! Activities !! Coverage reached (wp) !! Evaluation !! WER reached
 
|-
  
|-
−
| 0 || 23/04&mdash;21/05 || 45% || {{tag|ij}} {{tag|cnjcoo}} {{tag|cnjsub}} {{tag|cnjadv}} || 500 words || '''Preliminary evaluation'''. Translate the story total coverage and without diagnostics. Get a baseline WER.
 +
| 0 || 23/04&mdash;21/05 || Translating the story to get a baseline WER. || - || 500 words || 4.68%
 
|-
  
|-
−
| 1 || 21/05&mdash;27/05 || 50% || - || - ||
+
| 1 || 21/05&mdash;27/05 || Working on Indonesian analyzer/generator. || - || - || -
 
|-
  
|-
  +
| 2 || 28/05&mdash;03/06 || Working on Indonesian analyzer/generator.<br/>Translating Malaysian wikipedia articles to Indonesian to get a parallel corpus. Bilingual dictionaries will be [[Extracting bilingual dictionaries with Giza++|extracted]] from the corpus. || 72.9%, 29,9% || - || -
−
| 2 || 28/05&mdash;03/06 || 53% || - || - ||
 
 
|-
  
|-
−
| 3 || 04/06&mdash;10/06 || 59% || - || 200 words ||
 +
| 3 || 04/06&mdash;10/06 || Translating Malaysian wikipedia articles to Indonesian.<br/>Working on Malaysian analyzer/generator. || 74.9%, 46.4% || - || -
−
|-
  
⚫
| 4 || 11/06&mdash;17/06 || 63% || - || - ||
 
−
|-
  
−
| 5 || 18/06&mdash;24/06 || 68% || - || - ||
 
−
|-
  
−
| 6 || 25/06&mdash;01/07 || 70% || - || 500 words || '''Midterm evaluation'''.
 
−
|-
  
−
| 7 || 02/07&mdash;08/07 || 73% || - || - ||
  
−
|-
  
−
| 8 || 09/07&mdash;15/07 || 75% || - || - ||
  
−
|-
  
−
| 9 || 16/07&mdash;22/07 || 77% || - || 200 words ||
 
−
|-
  
−
| 10 || 23/07&mdash;29/07 || 80% || - || - ||
  
−
|-
  
−
| 11 || 30/07&mdash;05/08 || 80% || - || - ||
 
−
|-
  
−
| 12 || 06/08&mdash;12/08 || 80% || ''all categories clean'' || 500 words || '''Final evaluation'''. Tidying up, releasing
  
 
|-
  
|-
  ⚫
| 4 || 11/06&mdash;17/06 || Working on Malaysian analyzer/generator and bidix. || || - || -
 
|}
  
|}
−
-->
  
−
==Ideas for getting Indonesian-Malaysian bilingual dictionaries==
  
−  
−
# Filtering the Indonesian lemma list. For each lemma, check whether they are also valid Malaysian words.
  
−
# Interlanguage wiki links.
 
−
# Extracting bilingual dictionaries from parallel corpus.
  
−  
−
==Todo list==
  
−
# <s>Convert the Malaysian dictionary to Apertium format</s>
  
−
# <s>Create a script to get Indonesian word list</s>
  
−
# <s>Adding missing words from the story</s>
  
−
# <s>Adding conjunctives and interjections</s>
  
−
# Assigning correct parameter which will be reduplicated, for verbs with meN- (id)
  
−
# Passive form for verbs with meN- (id) (Done: V -> V no suffix; N -> V -kan)
  
−  
−
==External links==
  
−
* [http://pusatbahasa.kemdiknas.go.id/kbbi/ KBBI Daring]
  
−
* [http://prpm.dbp.gov.my/ PRPM's website]
  
−
* [http://kateglo.bahtera.org/api.php kateglo's website]
  
−
* [http://opus.lingfil.uu.se/ OPUS project]
  
−
* [http://wiki.apertium.org/wiki/Building_dictionaries#Getting_cheap_bilingual_dictionary_entries Getting cheap bilingual dictionary entries]
  
−
* [http://wiki.apertium.org/wiki/Extracting_bilingual_dictionaries_with_Giza%2B%2B Extracting bilingual dictionaries with Giza++]
  
   
−
[[Category:Indonesian and Malaysian|*]]
 +
[[Category:Indonesian and Malaysian]]

Revision as of 20:29, 10 June 2012

This is a workplan for development efforts for the Indonesian and Malaysian translator in Google Summer of Code 2012.

Week Dates Activities Coverage reached (wp) Evaluation WER reached
0 23/04—21/05 Translating the story to get a baseline WER. - 500 words 4.68%
1 21/05—27/05 Working on Indonesian analyzer/generator. - - -
2 28/05—03/06 Working on Indonesian analyzer/generator.
Translating Malaysian wikipedia articles to Indonesian to get a parallel corpus. Bilingual dictionaries will be extracted from the corpus.		 72.9%, 29,9% - -
3 04/06—10/06 Translating Malaysian wikipedia articles to Indonesian.
Working on Malaysian analyzer/generator.		 74.9%, 46.4% - -
4 11/06—17/06 Working on Malaysian analyzer/generator and bidix. - -
Retrieved from "https://wiki.apertium.org/w/index.php?title=Indonesian_and_Malaysian/Work_plan&oldid=34603"