User:Eden/GSoC progress

Community Bonding Period

• Find Swahili-Lingala resources
• Update Lingala lexc transducer to lexd
• New lexd transducer for Swahili
• Keep track of coverage for Lin and Swa transducers
• Get familiar with apertium-recursive
• Set up swa-lin pair using apertium-recursive
• Update GSOC progress page
• James and Marry story + Wikipedia article in Swahili and Lingala.

Goals

• By first evaluation: have story about kids or similar text to WER/PER of around 20% (work with all stages of translation, focus on "lowest-hanging fruit" relevant to the text)
• By second evaluation: increase [trimmed] coverage to around 90% (work focused on lexicons, adding from frequency lists)
• By final evaluation: work to get clean testvoc (work focused on transfer, making sure everything is dealt with one way or other)

Status table

Week		Stems			naïve coverage			WER,PER		Progress
№	dates	swa	lin	swa-lin	swa	lin	swa-lin	swa→lin	lin→swa	Evaluation	Notes
0 (community bonding)	May 4 - May 31	86	1,444	26
1	June 1 - June 7	86	1,444	26
2	May 8 - June 14	170	1,444	26							Number of stems in lin transducer comes from prev. estimates. Manually counted stems in swa transducer
3	June 15 - June 21	303	1,444	26							work was mainly collecting and finding stems.
4	June 22 - June 28	6,667	1,716	1,436		76.5%		94.40%	107.95%		several duplicates in the swa transducer.
5	June 29 - July 5
6	July 6 - July 12
7	July 13 - July 19
8	July 20 - July 26
9	July 27 - Aug 2
10	July 3 - Aug 9
11	Aug 10 - Aug 16
12	Aug 17 - Aug 23

Work

• June 8 - June 14

- verb, noun, adjective morphotatics in swa transducer

• June 15 - June 21

- add missing verb TAM(continuative, reciprocal,causative)(
- more subsections in 'Verb Morphotatics'
- add stems in swa transducer
- start writing transfer rules

Notes

• To count stems in lexc, try:

 grep -E ":\w+.*;" apertium-lin.lin.lexc | grep -v "[<>]" | wc -l

• To count stems in the bidix, try this:

 grep "<p" apertium-eng-lin.eng-lin.dix  | wc -l

• To get WER and PER use apertium-eval-translator-line

• Coverage above is on 2019-05-20 Wikipedia dump.