Difference between revisions of "User:Ilnar.salimzyan/GSoC2014/Application"
Jump to navigation
Jump to search
| (30 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| + | You can find my proposal for GSoC 2014 [http://www.google-melange.com/gsoc/proposal/public/google/gsoc2014/selimcan/5649050225344512 here]. |
||
| − | Remember that this is only a preview :) |
||
| + | [[Category:GSoC_2014_Student_proposals|Ilnar.salimzyan]] |
||
| − | == GSoC application: Apertium-kaz-tat: machine translation between Kazakh and Tatar == |
||
| − | '''Name:''' Ilnar Salimzyanov |
||
| − | |||
| − | '''E-mail adress:''' ilnar.salimzyan@gmail.com |
||
| − | |||
| − | ''Other information that may be useful to contact you:'' |
||
| − | |||
| − | '''IRC:''' selimcan '''Sourceforge account:''' selimcan '''Cellphone:''' +79625617985 '''Timezone:''' UTC+04.00 |
||
| − | |||
| − | ==Why is it you are interested in machine translation?== |
||
| − | |||
| − | ==Why is it that you are interested in the Apertium project?== |
||
| − | |||
| − | ==Which of the published tasks are you interested in? What do you plan to do?== |
||
| − | '''Task:''' |
||
| − | ''Adopting a language pair'' |
||
| − | |||
| − | '''Title:''' |
||
| − | ''Apertium-kaz-tat — machine translation between Kazakh and Tatar'' |
||
| − | |||
| − | ==Why should Google and Apertium sponsor it?== |
||
| − | |||
| − | ==How and whom it will benefit in society?== |
||
| − | |||
| − | ==Work plan== |
||
| − | |||
| − | For Kazakh-Tatar language pair I will not have to start from absolute scratch. Transducers for both languages perform quite well, having 76% and 71% coverage each <ref> Consult ‘Kazmorph’ and ‘Tatmorph’ pages on the wiki</ref>. Having that, I thought that the crucial thing to benefit from these separate transducers most with less work is to write bidix file, translating words from Kazakh lexc file into Tatar. |
||
| − | |||
| − | ; Bilingual dictionary |
||
| − | All words in kazakh.lexc <ref>/branches/apertium-kaz/</ref> were commented with English glosses (thanx who had done this!). Using a simple sed one-liner, I prepared bidix entries with Kazakh words as the left side, putting english glosses again into comments. In few hour’s work, I translated ~500 nouns (not proper nouns) and most of the adjectives into Tatar <ref>/branches/apertium-kaz-tat/words</ref>. For Kazakh words which look very similar to Tatar ones and have the same meaning as these Tatar equivalents, this can be done very quickly. For other I consulted Kazakh-Russian dictionaries too, but again, translating all remaining words from kazakh.lexc will take no more than few days of focused work. |
||
| − | |||
| − | ; Parallel Corpora |
||
| − | Some sentences are available at Tatoeba project<ref>www.tatoeba.org</ref>. As a source for parallel corpora Bible or Quran translations can serve<ref>See e.g. tanzil.net; kkitap.net; http://www.ibt.org.ru/english/bible/ttr.htm and kuran.kz</ref>. There are also both Kazakh and Tatar localization teams for several FOSS desktop environments <ref>?links to lxde, xfce, gnome and kde localization teams?</ref>, but the localizations are far from being complete. |
||
| − | |||
| − | ; Frequency lists |
||
| − | According to Francis Tyers, stems in Kazakh transducer were taken from a frequency list (obtained from Kazakh RLFE corpus), which is certainly good. As for Tatar, corpus.tatfolk.ru (a project aiming to create a web-crawled corpus of Tatar, similar in functionality with Wortschatz project), after sharing with them preprocessed pages collected by me earlier and concatenating them with what corpus.tatfolk.ru had, provided me a freqeuncy list of Tatar wordforms <ref>See branches/apertium-tat/words</ref>. |
||
| − | |||
| − | ==Work To do== |
||
| − | ; Before the coding period: |
||
| − | |||
| − | ; The coding period: |
||
| − | |||
| − | ==List your skills and give evidence of your qualifications== |
||
| − | |||
| − | I am the first year master’s student at the Kazan Federal University, studying Applied Linguistics <ref>A not-so-clear term, which caused many debates. What we study is a mix of computational linguistics, lexicography and several other courses.</ref> |
||
| − | |||
| − | I got to know about Apertium first time in 2009, while writing a small paper at the university on comparison of available machine translation systems. Apertium fascinated me then being open source, showing rapid growth and being a good potential starting point for Tatar and other Turkic languages (yes, I have thought about them too). I played around with lttoolbox dictionary for Tatar (bad idea, I know, but I didn’t know about "X/S/HFST"s then and there weren’t any other Turkic languages involved). I even managed to model nouns morphotactics using it! |
||
| − | |||
| − | Back in 2009 I translated part of the Official Documentation into Russian <ref> See /apertium/trunk/apertium-documentation/apertium-2.0/ru/apertium_docu.odt</ref> (till chapter 3.2.3; besides someone willing to finish it the translation needs a good editor). Also in 2009 I translated Apertium New language pair Howto into Russian. |
||
| − | |||
| − | I was one of the participants of the Šupaškar Apertium Workshop, held in January this year, where Francis Tyers, Hector Alos-i-Font, |
||
| − | Jonathan Washington and Trond Trosterud were instructors. |
||
| − | |||
| − | I was very fortunate to see Jonathan and Francis work on Tatar-Bashkir pair as an example pair for the Šupaškar Workshop and move it to nursery. It is very useful to have a transducer for my native language (and a language closest to it) to learn the semantics and structure of lexc and twol files (which I wasn’t really familiar with, since using HFST with Apertium is relatively new thing and it is not mentioned in the Official Documentation), along with the reading the famous FSMBook. |
||
| − | |||
| − | I have been involved in work on Tatar-Bashkir pair as, let’s say, “language-consultant” and “tester”<ref>See accepted, but not-yet-published paper here: https://www.softconf.com/lrec2012/TurkicLanguage2012/cgi-bin/scmd.cgi?scmd=getFinal&passcode=18X-P9A6A3D6H8&_lDoc=Paper</ref>. With another fellow from Ufa we have been translating top-5000 wordlist of Russian National Corpus into Tatar and Bashkir. This translations were added then to the translator files. Also, I have been analyzing some errors in the translations finding out, where Apertium-tt-ba performed not so well, describing it on the wiki <ref>The Morphology of Tatar Language</ref> and commiting from time to time to svn. |
||
| − | |||
| − | ==Non-GSoC activities== |
||
| − | |||
| − | ==References== |
||
| − | <references/> |
||
| − | |||
| − | [[Category:GSoC 2012 Student Proposals]] |
||
Latest revision as of 13:17, 14 May 2014
You can find my proposal for GSoC 2014 here.
