User:Mjaskowski - Revision history

Mjaskowski: not a draft anymore!

2010-04-09T18:45:37Z

not a draft anymore!

Mjaskowski: many minor edits, in fact

2010-04-09T18:45:17Z

many minor edits, in fact

Mjaskowski at 18:27, 9 April 2010

2010-04-09T18:27:10Z

Mjaskowski: many minor edits, in fact

2010-04-09T18:26:09Z

many minor edits, in fact

Mjaskowski: /* Understanding of the problem */

2010-04-09T18:10:51Z

Understanding of the problem

Mjaskowski: /* Understanding of the problem */ fst

2010-04-09T18:01:41Z

Understanding of the problem: fst

Mjaskowski: /* Time Line */ fst

2010-04-09T17:52:49Z

Time Line: fst

Mjaskowski: /* Deliverables */

2010-04-09T17:51:13Z

Deliverables

Mjaskowski: /* Time Line */

2010-04-09T15:14:29Z

Time Line

Mjaskowski: /* Time Line */

2010-04-09T15:14:16Z

Time Line

@@ Line 8: / Line 8: @@
 I live in Poland => CE time
-a draft submitted to GSOC at 11.20 a.m. CET, 9 april
 == Abstract ==

@@ Line 53: / Line 53: @@
 But the more I IRC/mail with you, the more I learn about Apertium, the more code I read, I get persuaded that Apertium is not only the best known (to Google[http://www.google.com/search?client=safari&rls=en&q=open+source+machine+translation&ie=UTF-8&oe=UTF-8]) open-source MT system but also a one with great community around which is I believe of crucial importance for huge projects like this.
-I strongly believe, that during that project I will understand in detail how does Apertium work and that it might help me in my future commitments as a PhD student.
+I strongly believe, that during that project I will understand in detail how does Apertium work which might help me in my future commitments as a PhD student.
 == Which of the published tasks are you interested in? ==
@@ Line 260: / Line 260: @@
 '''Education: '''
-I have just graduated in mathematics on the University of Warsaw [http://www.mimuw.edu.pl] (got 5 on MSc diploma; 5 is the best mark in Poland). I spend 10 months on Erasmus in Ecole Polytechnique (Palaiseau) and had some brilliant results <br/>
+'''2004-march 2010:''' I have just graduated in mathematics on the University of Warsaw [http://www.mimuw.edu.pl] (got 5 on MSc diploma in 2-5 scale; 5 is the best mark in Poland). I spend 10 months on Erasmus in Ecole Polytechnique (Palaiseau) and had some brilliant results
-Right now I am pursuing MSc in computer science on the same faculty (expected graduation date: june 2011). <br/> My GPA in both subjects exceeds 4.6 (5 being the best mark, 2 the worst one).<br/>
+'''2005-now:''' pursuing MSc in computer science on the same faculty (expected graduation date: june 2011). <br/> My GPA in both subjects exceeds 4.6 (5 being the best mark, 2 the worst one; top 10% of students every year).
-I am also looking for a good oportunity to start PhD studies on problems related to machine learning and/or computational linguistics in general.
+'''2003:''' finalist of Polish Olympiad in Informatics
+'''2003,2002:''' finalist of Polish Olympiad in Mathematics
+'''Relevant Coursework:'''
+* Objective Oriented Programming (A)
+* Algorithmics and Data Structures (B+)
+* Computational Mathematics (A)
+* Approximate Reasoning (B+)
+* Probability Theory I (B+)
+* Probability Theory II (A!)
+Right now I am looking for a good oportunity to start PhD studies on problems related to machine learning and/or computational linguistics in general.
 <br/><br/>
 '''Linguistics: '''
@@ Line 279: / Line 295: @@
 We managed to make a long jump from an almost non-existing SG with a single person actively acting, to a SG where 10 guys (or 1% of the students) is highly involved and other 10-15 is supporting it from time to time. To a SG which works like a small company :-) <br/>
 Here[http://samorzad.mimuw.edu.pl/2010/03/13/na-abdykacje/] you can find some statistics.
+'''References:'''
+Adam Przepiórkowski, PhD [http://nlp.ipipan.waw.pl/~adamp/]
+Andrzej Skowron, prof. [http://www.mimuw.edu.pl/wydzial/organizacja/pracownicy/andrzej.skowron.xml]
+Tadeusz Mostowski, prof. [http://www.mimuw.edu.pl/wydzial/organizacja/pracownicy/tadeusz.mostowski.xml]

@@ Line 3: / Line 3: @@
 '''E-mail address''' maciej.jaskowski on gmail account
-'''IRC''': mjaskowski (not registered!)
+'''IRC''': mjaskowski (not registered!) or mjaskow
 '''skype''': maciej.jaskowski (usually I'm offline though)

@@ Line 21: / Line 21: @@
 == Why is it you are interested in machine translation? ==
-I can speak 4 languages (Polish, French, English and German) and learning a new langauge is always for me something cool.
+I can speak 4 languages (Polish, French, English and German) and learning a new langauge is always exciting for me.
 I know as well how much time does one need to learn yet another language.
-I can only imagine problems arising if one wants to learn a language which is not as popular as languages I have mentioned above (specifically, try learning Polish!)
+I can only imagine problems arising if one wants to learn a language which is not as popular as languages I have mentioned above (for example, try learning Polish!)
 But why do we learn languages in the first place?
@@ Line 31: / Line 31: @@
 The knowledge of languages helps me quite a lot in everyday web crawling.
 In fact I can't imagine ignoring the english or french part of Web.
-And it is the information which is arguably the most important thing in the 21st century!
+And it is the information which is arguably one of the most important thing in the 21st century!
-MT may give us access to all the information world wide which we don't right now!
+MT may give us access to all the information the people all over the world have gathered.
 Translation is of specifically high importance for EU where each language is equally important according to the EU law.
-That is why MT is sooo important these days and also why it interesting. It is always interesting to mess with stuff which is needful.
+That is why MT is sooo important these days and also why it is interesting. To mess with stuff which is needful -- I love it!
+I like to think about MT as a way to reverse the curse of Babel[http://en.wikipedia.org/wiki/Tower_of_Babel] :-)
-MT is like a Holy Grail for Computational Linguistics in which I find a particular interest.
-And why do I like it?
+And MT is like a Holy Grail for Computational Linguistics in which I find a particular interest.
-Because it combines to a large extent all my scientific interests: machine learning, data mining and linguistics.
+Apart from all that, MT combines to a large extent all my scientific interests: machine learning, data mining and linguistics.
@@ Line 47: / Line 49: @@
 From the beginning, however, I knew that I want to get involved into a project related to linguistics, machine learning or data mining.
-These are stuff I am interested in and I want to dive into them during my PhD studies. And that is how I found Apertium.
+These are stuff I am interested in and I want to dive into it during my PhD studies. And that is how I found Apertium.
-But the more I talk with you, the more I learn about Apertium, the more code I read, I get persuaded that Apertium is not only the best known (to Google) open-source MT system but also one with fine community around which is I believe of crucial importance for huge projects like that one.
+But the more I IRC/mail with you, the more I learn about Apertium, the more code I read, I get persuaded that Apertium is not only the best known (to Google[http://www.google.com/search?client=safari&rls=en&q=open+source+machine+translation&ie=UTF-8&oe=UTF-8]) open-source MT system but also a one with great community around which is I believe of crucial importance for huge projects like this.
-I believe and hope, that during that project I will understand in detail how does Apertium work and that it might help me in my future commitments as a PhD student.
+I strongly believe, that during that project I will understand in detail how does Apertium work and that it might help me in my future commitments as a PhD student.
 == Which of the published tasks are you interested in? ==

@@ Line 134: / Line 134: @@
 We can also consider measuring the robustness of the PoS tagger with or without diacritic restoration.
 If we decide to implement some kind of diacritic restoration built in one of the existing apps in the pipeline, this measure will help us compare different approaches.
-'''technical details'''
 == Some ideas and remarks ==

@@ Line 111: / Line 111: @@
 The xml corpora might either be gathered from Wikipedia or we may reuse the data already gathered by Kevin (we have the binary data used by his charlifter).
+jimregan suggested, and I like that idea, that the 'inner pipeline' should look like this: corpus -> xml frequencies -> fst data along with probabilities/frequencies.
+The fst data will say something like 'pol' -> 'pół' (0.99), 'pol' -> 'pol' (0.01) or (in LL2) 'pol litra' -> 'pół litra' (0.999), 'pol litra' -> 'pol litra' (0.001)
+(the details of FSTProcessor are to be investigated).
+The diacritic restoration part then will simply read the fst data along with probabilities and it may focus directly on restoring diacritics.
 '''evaluation'''
@@ Line 129: / Line 134: @@
 We can also consider measuring the robustness of the PoS tagger with or without diacritic restoration.
 If we decide to implement some kind of diacritic restoration built in one of the existing apps in the pipeline, this measure will help us compare different approaches.
+'''technical details'''
 == Some ideas and remarks ==

@@ Line 209: / Line 209: @@
 (I have some commitments there, so my involvement may not be very high)
 * gathering data sets for training (at least french and polish)
-* checking which existing code of Apertium can I reause (e.g. reading deformatted input?)
+* checking which existing code of Apertium can I reause (e.g. FSTprocessor) and how to do it properly. Playing with it a bit.
 * unit tests for LLU correctness
 * plan of how to implement LLU
-* write a script which converts current charlifter's binary data files into some more human readable and editable format.
+* write a script which converts current charlifter's binary data files into some more human readable and editable, possibly xml format.
 At the end of the period:

@@ Line 181: / Line 181: @@
 ** data sets for training (source: WikiPedia, for each language!)
 *** write/get a WikiPedia crawler and/or reuse data gathered by Kevin Scannell
+**** and create xml data store gathering all the information needed
+**** and create fst data store from xmls
 *** write/get app for (partial) ascification
 *** pass them through deformatter