User:Oresta/GSoC Proposal - Revision history

Oresta at 12:38, 9 April 2010

2010-04-09T12:38:48Z

Oresta: /* Work plan */

2010-04-09T11:55:27Z

Work plan

Oresta: /* List your skills and give evidence of your qualifications */

2010-04-09T11:39:56Z

List your skills and give evidence of your qualifications

Oresta: /* List any non-Summer-of-Code plans you have for the Summer */

2010-04-09T11:35:04Z

List any non-Summer-of-Code plans you have for the Summer

Oresta: /* Week 9 */

2010-04-09T11:33:10Z

Week 9

Oresta: /* Work plan */

2010-04-09T11:31:52Z

Work plan

Oresta: /* Work plan */

2010-04-09T11:25:39Z

Work plan

Oresta: /* Work plan */

2010-04-09T11:18:33Z

Work plan

Oresta: /* Why is it that you are interested in the Apertium project? */

2010-04-09T02:23:39Z

Why is it that you are interested in the Apertium project?

Oresta: /* Community Bonding Period */

2010-04-09T02:05:32Z

Community Bonding Period

@@ Line 8: / Line 8: @@
 IRC: Oresta in #apertium at irc.freenode.net<br />
 Cell phone: +38 067 37 97 836<br />
+== Abstract ==
+Both Polish and Ukrainian belonging to the Slavic languages group, which is not well represented in Apertium yet. There is no releases for Polish and Ukrainian, but bilingual dictionary for these languages already exists as well as preliminary version of Polish and pre-preliminary version of Ukrainian monolingual dictionaries. All dictionaries needs expanding to have at least 5,000 words, adding paradigms and transfer rules.
 == Why is it you are interested in machine translation?  ==

@@ Line 48: / Line 48: @@
 Most comfortable way to build any kind of dictionaries is to use well formed annotated corpus. That’s why for Polish I will use Polish IPI PAN Corpus (250 mln words) - GNU GPL (http://korpus.pl/index.php?page=download) and open source corpus manager Poliqarp - Creative Commons License (http://korpus.pl/index.php?page=poliqarp). IPI PAN Corpus is POS- and morpho-syntactically tagged, it gives a possibility to get all necessary information to build Polish monolingual dictionary. Existing Polish monolingual dictionary will be helpful too, because it describes a lot of word inflections.<br />
 There is not available open source corpus for Ukrainian :(. That’s why I am going to use Ukrainian Wikipedia to form Ukrainian frequency list. Also I will use Aspell Ukrainian Dictionary (http://sourceforge.net/projects/ispell-uk). It is distributed under GNU GPL and contains approximately 100,000 lemmas. Aspell Dictionary consists from two files:<br />
-* dictionary – includes lemmas, and affix labels for each lemma, which describes inflection rules for each lemma<br />
+* dictionary – includes lemmas and affix labels which describes inflection rules for each lemma<br />
 * list of affixes – includes affixes for each type of label.<br />
 There is no explicit information about Parts of Speech in this dictionary, but inflection categories are described. Since different parts of speech has different inflection rules – getting POS information from this vocabulary is  possible. Summing up, converting Aspell Dictionary to the Ukrainian monodix for Appertium is realistic task.<br />

@@ Line 103: / Line 103: @@
 == List your skills and give evidence of your qualifications ==
-Presently I am 2-th year PhD student in Computer Sciences at Lviv Polytechnic University. <br />
+Presently I am 2nd year PhD student in Computer Sciences at Lviv Polytechnic University. <br />
 I have been one year (2007-2008) at International Visegrad Master Program at the University of Warsaw.<br />
 I attended courses "Methods and Tools for Text Processing" (Prof. Janusz Stanisław Bień) and "Linguistic Engineering" (Dr. Adam Przepiórkowski). This made me familiar with different NLP techniques and corpus standards, like text segmentation, HMM, PoS tagging,  XML, TEI, Unicode, etc.<br />

← Older revision		Revision as of 11:35, 9 April 2010
Line 113:		Line 113:
	== List any non-Summer-of-Code plans you have for the Summer ==		== List any non-Summer-of-Code plans you have for the Summer ==

	GsoC is my only plan for the summer.		GsoC is my only plan for the summer. I can work full time on the project.

@@ Line 89: / Line 89: @@
 === Week 9 ===
+Continuation of work on transfer rules.
 === Week 10 ===

@@ Line 61: / Line 61: @@
 === Week 1 ===
+Forming frequency list for Ukrainian from Wikipedia.<br />
+Working on Ukrainian morphological dictionary, focusing on closed class words.
 === Week 2 ===
+Making of paradigms for Ukrainian morphological dictionary.<br />
+Starting adding open class words.
 === Week 3 ===
+Continuation of work on Ukrainian morphological dictionary by adding open class words.
 === Week 4 ===
+Working with existing Polish morphological dictionary, adding closed class words.
 === Week 5 ===
+Making of paradigms for Polish morphological dictionary.<br />
+Starting adding open class words.
 === Week 6 ===
+Adding open class words to Polish morphological dictionary.
 === Week 7 ===
+Synchronizing  bilingual and monolingual dictionaries.<br />
+After that size of each dictionary should be 5,000 minimum.
 === Week 8 ===
+Working on transfer rules.
 === Week 9 ===
@@ Line 89: / Line 92: @@
 === Week 10 ===
+Testing and manual correction of dictionaries.<br />
+Adding transcription rules.
 === Week 11 ===
+Continuation testing and manual correction of dictionaries.
 === Week 12 ===
+Evaluating accuracy and project documenting.
 == List your skills and give evidence of your qualifications ==

@@ Line 47: / Line 47: @@
 Firstly I want to say, I do not starting from scratch. Bilingual Polish-Ukrainian dictionary exists in Apertium format. I already checked it with a mentor Jimmy O’Regan. Of course it needs expanding by adding high frequently words and correction some translations.<br />
 Most comfortable way to build any kind of dictionaries is to use well formed annotated corpus. That’s why for Polish I will use Polish IPI PAN Corpus (250 mln words) - GNU GPL (http://korpus.pl/index.php?page=download) and open source corpus manager Poliqarp - Creative Commons License (http://korpus.pl/index.php?page=poliqarp). IPI PAN Corpus is POS- and morpho-syntactically tagged, it gives a possibility to get all necessary information to build Polish monolingual dictionary. Existing Polish monolingual dictionary will be helpful too, because it describes a lot of word inflections.<br />
-There is not available open source corpus for Ukrainian :(. That’s why I am going to use Ukrainian Wikipedia to form Ukrainian frequency list. Also I will use Aspell Ukrainian Dictionary (    http://sourceforge.net/projects/ispell-uk). It is distributed under GNU GPL and contains approximately 100 000 lemmas. Aspell Dictionary consists from two files:<br />
+There is not available open source corpus for Ukrainian :(. That’s why I am going to use Ukrainian Wikipedia to form Ukrainian frequency list. Also I will use Aspell Ukrainian Dictionary (    http://sourceforge.net/projects/ispell-uk). It is distributed under GNU GPL and contains approximately 100,000 lemmas. Aspell Dictionary consists from two files:<br />
 * dictionary – includes lemmas, and affix labels for each lemma, which describes inflection rules for each lemma<br />
 * list of affixes – includes affixes for each type of label.<br />

@@ Line 16: / Line 16: @@
 == Why is it that you are interested in the Apertium project? ==
+Apertium is a great example of fast developing open source project. It is open for everyone to use and to develop. <br />
+In most of MT systems such languages like Ukrainian appears in the least. But in Appertium community an idea of Polish-Ukrainian translation was graciously accepted.<br />
+I like atmosphere in Apertium community which I saw at IRC and mailing list.
 == Why should Google and Apertium sponsor it ? ==

@@ Line 53: / Line 53: @@
 === Community Bonding Period ===
-Learning and comparison of Polish and Ukrainian grammar;
+Learning and comparison of Polish and Ukrainian grammar;<br />
-Studying Apertium and its documentation;
+Studying Apertium and its documentation;<br />
-Evaluating and correcting existing dictionaries;
+Evaluating and correcting existing dictionaries.
 === Week 1 ===