User:Aboelhamd/progress

GSOC 2019 : Extend weighted transfer rules progress

I will upload the code in this repo[1].

Phase 1 (April 19 : May 16)

From April 19 to May 16 and from June 21 to June 28.
It's shifted because of my exams.

Week 1 (April 19 : April 25)

Day 1 (Friday April 19)

Latest evaluation scores were lower than traditional apertium's LRLM resolution, by far, unfortunately.
Debugged the code to see what's the cause of such low evaluation score.
Figured out that there is a bug in normalizing the LM scores of the target ambiguous sentences. The LM score is a log base 10 the probability of the sentence, and as the magnitude gets higher, the sentence normalizing probability should get lower, and I was doing the inverse of that.
The easiest solution was to modify the score-sentences script, and instead of getting the score, will get its reciprocal.

Day 2 (Saturday April 20)

The evaluation results were better, but still not better than traditional apertium's LRLM resolution.
Debugged the code to see why the score still worse than apertium's.
Found a bug in generating the ambiguous combinations and still working on solving it.
The bug resulted some incomplete sentences like:
Sentence : Reciprocal of negative LM score
Resumption of the period of sessions : 0.0552026445652
Resumption of session period : 0.0739337147853
Resumption of the session period : 0.0753641871191
Resumption of the period of : 0.0757469108192
Resumption of period of : 0.0684245152522
Resumption of the period : 0.0809504851312

And as shown, the best score went to incomplete sentence, which is one of the reason why we got bad evaluation score.

Week 5 (June 21 : June 27)

After my exams.

---

---