User:Techievena/GSoC 2018 Work Product Submission - Revision history

Techievena: Add acknowledgement

2018-08-09T05:50:31Z

Add acknowledgement

Techievena: Add work to be done

2018-08-09T05:22:42Z

Add work to be done

Techievena: Add work done

2018-08-09T05:12:26Z

Add work done

Show changes

Techievena: Add Initial description

2018-08-09T02:01:59Z

Add Initial description

New page

__NOTOC__
==== Apertium ====
=== Abinash Senapati ===
Hi I am Abinash, a final year undergraduate in the department of Electronics and Electrical Communication Engineering, Indian Institute of Technology, Kharagpur. I was a Google Summer of Code student for Apertium over the summer of 2018 and primarily worked on lttoolbox and apertium-core. My project involved extending the capability of performing morphographemics and adding lexical weights to the lttoolbox transducer in order to enable more complex translations with the transducer.

==== Project Title ====
[https://summerofcode.withgoogle.com/projects/#4841842567282688 Extend lttoolbox to have the power of HFST]

==== GSoC Blog ====
https://techievena.github.io/categories/GSoC

==== Public Profiles ====
GitHub: [https://github.com/Techievena Techievena] 
GitLab: [https://gitlab.com/Techievena Techievena] 
IRC nick: Techievena 
Apertium wiki: [http://wiki.apertium.org/wiki/User:Techievena Techievena] 
E-mail: [mailto:abinashsena@gmail.com abinashsena@gmail.com]

==== Mentors ====
[http://wiki.apertium.org/wiki/User:Francis_Tyers Francis Tyers] and [http://wiki.apertium.org/wiki/User:TommiPirinen Tommi Pirinen]

==== Patches ====
tarball: [https://apertium.projectjj.com/gsoc2018/techievena.tar.gz Download] 
zip: [https://apertium.projectjj.com/gsoc2018/techievena.zip Download]

==== Link to commits and repositories I have worked on ====
https://apertium.projectjj.com/gsoc2018/techievena.html

=== Extend lttoolbox to have the power of HFST ===
==== Work Done ====
==== Challenges ====
==== Work to be done ====
==== Thanksgiving ====

@@ Line 246: / Line 246: @@
 ==== Challenges ====
+Overall, it was a wonderful and satisfying experience. I had a great learning experience and had a great time coding for Apertium.<br/>
+But in the meanwhile a lot of unexpected challenges popped up which were very hard to get over. Debugging such a large codebase in C++ language and that too when you are modifying three repositories simultaneously was a huge pain in the ass. I got stuck in the debugging task for a long time during the GSoC period. Hadn't been there the help from my mentors and the other mentors at Apertium, I don't think I could have fixed that bug. As the display of my laptop broke during the second phase, I had a really hard time contributing then. For almost 2-3 weeks during the second phase, I didn't have my own stable system all set up for development.<br/>
+Fortunately all these issues got fixed and I therefore was able to make a proper implementation of weights within the desired period.
 ==== Work to be done ====
 Now that we can weight our morphological analysers, generators and bilingual dictionaries.
@@ Line 266: / Line 270: @@
 * Dealing with non-standard forms, instead of having to use LR/RL direction restrictions, you can just make non-standard forms have a high weight and ask for lt-proc to only generate the surface form with the lowest weight.
-==== Thanksgiving ====
+==== Acknowledgements ====
+Thanks a lot to all my fellow apertiumers for making my so far wonderful journey with Apertium. I was very fortunate to get this opportunity to work with this wonderful organisation. All the mentors are very helpful and this project wouldn't possible without their constant help and guidance. There is always someone or the other hanging out on IRC there to help you. Thank you fellas.<br/>
+I’ll definitely keep on contributing to Apertium after my GSoC.

@@ Line 27: / Line 27: @@
 https://apertium.projectjj.com/gsoc2018/techievena.html
+----
 === Extend lttoolbox to have the power of HFST ===
@@ Line 246: / Line 247: @@
 ==== Challenges ====
 ==== Work to be done ====
+Now that we can weight our morphological analysers, generators and bilingual dictionaries.
+Here are some problems that can be solved:
+* Having zero-context rules in your .lrx files. Now you can just put the weights directly in your bilingual dictionary
+<pre>
+$ echo "^estación<n><f><sg>$" | lt-proc -W -b testbidix.bin
+^estación<n><f><sg>/season<n><W:1.000000><sg>/station<n><W:1.500000><sg>$
+$ echo "^estación<n><f><sg>$" | lt-proc -b testbidix.bin
+^estación<n><f><sg>/season<n><sg>/station<n><sg>$
+</pre>
+Analyses will be output according to lowest weight first. So you can mark your default translation as "1.0" and then all others as >1.0 ... because of how transfer works, it will always take the first, which will be the one with the lowest weight.
+* Improving POS-tagging accuracy by ordering analyses by probability. This way if your CG doesn't mop up all the ambiguity, you will get the best remaining analysis. This works kind of like the unigram tagger, but because it can be in the analyser itself, it can be easier to control.
+* Dealing with non-standard forms, instead of having to use LR/RL direction restrictions, you can just make non-standard forms have a high weight and ask for lt-proc to only generate the surface form with the lowest weight.
 ==== Thanksgiving ====