Difference between revisions of "Indonesian and Malaysian/Work plan"

From Apertium
Jump to navigation Jump to search
Line 5: Line 5:
 
! Week !! Dates !! Main activities !! Coverage reached (wp) !! Evaluation !! WER reached
 
! Week !! Dates !! Main activities !! Coverage reached (wp) !! Evaluation !! WER reached
 
|-
 
|-
| 0 || 23/04—21/05 || Translating the story to get a baseline WER. || - || 500 words || 4.68% (id->ms)
+
| 0 || <s>23/04&mdash;21/05</s> || Translating the story to get a baseline WER. || - || 500 words || 4.68% (id->ms)
 
|-
 
|-
| 1 || 21/05&mdash;27/05 || Working on Indonesian analyzer/generator. || - || - || -
+
| 1 || <s>21/05&mdash;27/05</s> || Working on Indonesian analyzer/generator. || - || - || -
 
|-
 
|-
| 2 || 28/05&mdash;03/06 || Working on Indonesian analyzer/generator.<br/>Translating Malaysian wikipedia articles to Indonesian to get a parallel corpus.<br/>Bilingual dictionaries will be [[Extracting bilingual dictionaries with Giza++|extracted]] from the corpus. || 72.9%, 29.9% || - || -
+
| 2 || <s>28/05&mdash;03/06</s> || Working on Indonesian analyzer/generator.<br/>Translating Malaysian wikipedia articles to Indonesian to get a parallel corpus.<br/>Bilingual dictionaries will be [[Extracting bilingual dictionaries with Giza++|extracted]] from the corpus. || 72.9%, 29.9% || - || -
 
|-
 
|-
| 3 || 04/06&mdash;10/06 || Translating Malaysian wikipedia articles to Indonesian.<br/>Working on Malaysian analyzer/generator. || 74.9%, 46.4% || - || -
+
| 3 || <s>04/06&mdash;10/06</s> || Translating Malaysian wikipedia articles to Indonesian.<br/>Working on Malaysian analyzer/generator. || 74.9%, 46.4% || - || -
 
|-
 
|-
| 4 || 11/06&mdash;17/06 || Working on Malaysian analyzer/generator and bidix. || 75.6%, 72.9% || - || -
+
| 4 || <s>11/06&mdash;17/06</s> || Working on Malaysian analyzer/generator and bidix. || 75.6%, 72.9% || - || -
 
|-
 
|-
| 5 || 18/06&mdash;24/06 || Working on Malaysian analyzer/generator and bidix. || 80.1%, 77.5% || 300 words || 2.97% (id->ms)
+
| 5 || <s>18/06&mdash;24/06</s> || Working on Malaysian analyzer/generator and bidix. || 80.1%, 77.5% || 300 words || 2.97% (id->ms)
 
|-
 
|-
| 6 || 25/06&mdash;1/07 || Working on bidix. || || ||
+
| 6 || 25/06&mdash;01/07 || Working on bidix. || || ||
 
|}
 
|}
   

Revision as of 17:48, 24 June 2012

This is a workplan for development efforts for the Indonesian and Malaysian translator in Google Summer of Code 2012.

Week Dates Main activities Coverage reached (wp) Evaluation WER reached
0 23/04—21/05 Translating the story to get a baseline WER. - 500 words 4.68% (id->ms)
1 21/05—27/05 Working on Indonesian analyzer/generator. - - -
2 28/05—03/06 Working on Indonesian analyzer/generator.
Translating Malaysian wikipedia articles to Indonesian to get a parallel corpus.
Bilingual dictionaries will be extracted from the corpus.
72.9%, 29.9% - -
3 04/06—10/06 Translating Malaysian wikipedia articles to Indonesian.
Working on Malaysian analyzer/generator.
74.9%, 46.4% - -
4 11/06—17/06 Working on Malaysian analyzer/generator and bidix. 75.6%, 72.9% - -
5 18/06—24/06 Working on Malaysian analyzer/generator and bidix. 80.1%, 77.5% 300 words 2.97% (id->ms)
6 25/06—01/07 Working on bidix.

Ideas for getting Indonesian-Malaysian bilingual dictionaries

  1. Filtering the Indonesian lemma list. For each lemma, check whether they are also valid Malaysian words.
  2. Interlanguage wiki links.
  3. Extracting bilingual dictionaries from parallel corpus.

Todo list

  1. Convert the Malaysian dictionary to Apertium format
  2. Create a script to get Indonesian word list
  3. Adding missing words from the story
  4. Adding conjunctives and interjections
  5. Assigning correct parameter which will be reduplicated, for verbs with meN- (id)
  6. Passive form for verbs with meN- (id) (Done: V -> V no suffix, no suffix + -kan; N -> V -kan)
  7. ter-, se-, peN-an, per-an
  8. Alternative POS for each word
  9. diper-, ber-an, ber-kan
  10. Check from the inflected and derived form, whether the lemma has been added as a separate entry
  11. ke-an variations -> better tag naming

External links