User:Eden/GSoC progress
< User:Eden
Jump to navigation
Jump to search
Revision as of 16:50, 6 June 2020 by Firespeaker (talk | contribs) (→Status table: evaluation metrics)
Community Bonding Period
- Find Swahili-Lingala resources
- Update Lingala lexc transducer to lexd
- New lexd transducer for Swahili
- Keep track of coverage for Lin and Swa transducers
- Get familiar with apertium-recursive
- Set up
swa-lin
pair using apertium-recursive - Update GSOC progress page
- James and Marry story + Wikipedia article in Swahili and Lingala.
Goals
- By first evaluation: have story about kids or similar text to WER/PER of around 20% (work with all stages of translation, focus on "lowest-hanging fruit" relevant to the text)
- By second evaluation: increase [trimmed] coverage to around 90% (work focused on lexicons, adding from frequency lists)
- By final evaluation: work to get clean testvoc (work focused on transfer, making sure everything is dealt with one way or other)
Status table
Week | Stems | naïve coverage | WER,PER | Progress | |||||
---|---|---|---|---|---|---|---|---|---|
№ | dates | lin, swa | swa-lin | lin, swa | swa-lin | swa→lin | lin→swa | Evaluation | Notes |
0 (community bonding) | May 4 - May 31 | ||||||||
1 | June 1 - June 7 | ||||||||
2 | May 8 - June 14 | ||||||||
3 | June 15 - June 21 | ||||||||
4 | June 22 - June 28 | ||||||||
5 | June 29 - July 5 | ||||||||
6 | July 6 - July 12 | ||||||||
7 | July 13 - July 19 | ||||||||
8 | July 20 - July 26 | ||||||||
9 | July 27 - Aug 2 | ||||||||
10 | July 3 - Aug 9 | ||||||||
11 | Aug 10 - Aug 16 | ||||||||
12 | Aug 17 - Aug 23 |
Notes
- To count stems in
lexc
, try:
grep -E ":\w+.*;" apertium-lin.lin.lexc | grep -v "[<>]" | wc -l
- To count stems in the bidix, try this:
grep "<p" apertium-eng-lin.eng-lin.dix | wc -l
- To get WER and PER use
apertium-eval-translator-line
- Coverage above is on 2019-05-20 Wikipedia dump.