Difference between revisions of "User:Anakuznetsova/Proposta"

From Apertium
Jump to navigation Jump to search
Line 43: Line 43:
|-
|-
! style="width:30em;" |Period
! style="width:30em;" |Period
! style="width:80em;" |Tasks
! style="width:70em;" |Tasks
! style="width:15em; |Coverage
|-
|-
|'''Post application period
|'''Post application period
Line 60: Line 61:


* Discussing more detailed work plan with mentors (based on the results of Post-Application Period).
* Discussing more detailed work plan with mentors (based on the results of Post-Application Period).
|
30-50%
|
|-
|-
!colspan="2" style="border: 1px solid black; padding: 5px; background: #ffdead;" | Stage I. Morphological Analyzer
!colspan="3" style="border: 1px solid black; padding: 5px; background: #ffdead;" | Stage I. Morphological Analyzer


|-
|-
Line 69: Line 73:
* Adding nouns;
* Adding nouns;
* Writing rules for nouns.
* Writing rules for nouns.
|
50 - 55%
|-
|-
|'''Week 2
|'''Week 2
Line 75: Line 81:
* Adding verbs to the lexicon;
* Adding verbs to the lexicon;
* Writing rules for verbs.
* Writing rules for verbs.
|
60%
|-
|-
|'''Week 3
|'''Week 3
Line 80: Line 88:
|
|
* Still working on verbs.
* Still working on verbs.
|
65%
|-
|-
|'''Week 4
|'''Week 4
Line 87: Line 97:
* Preparing for the first evaluation;
* Preparing for the first evaluation;
* Run first tests.
* Run first tests.
|
70%
|-
|-
|'''Week 5
|'''Week 5
Line 94: Line 106:
* Writing rules for them;
* Writing rules for them;
* Brushing up morphological analyzer.
* Brushing up morphological analyzer.
|
75%
|-
|-
|'''Weeks 6
|'''Weeks 6
Line 99: Line 113:
|
|
*Finishing up monolingual dictionary.
*Finishing up monolingual dictionary.
|
80%
|-
|-
!colspan="2" style="border: 1px solid black; padding: 5px; background: #ffdead;"| Stage II. Lexical Transfer
!colspan="3" style="border: 1px solid black; padding: 5px; background: #ffdead;"| Stage II. Lexical Transfer
|-
|-
|'''Weeks 7 - 10
|'''Weeks 7 - 10
Line 109: Line 125:
** Writing transition rules;
** Writing transition rules;
* Preparing for second evaluation (9th of July).
* Preparing for second evaluation (9th of July).
|
80 - 90%
|-
|-
|'''Weeks 11 - 12
|'''Weeks 11 - 12

Revision as of 20:30, 9 April 2018


Contact Information

Anastasia Kuznetsova

E-mail: menina.indigena.17@gmail.com

GitHub: ana-kuznetsova

Phone number: +7 916 804 79 55

Timezone: UTC+3


Why is it that you are interested in the Apertium project?

I have a great interest in Apertium project because it pays attention not only to large-source languages that have lots of speakers around the world, but also to low-source languages. It is not an easy task to find a web version of a dictionary or a translator for such languages, although sometimes it is necessary. Nowadays machine translation based on neural networks prevails, but sometimes it becomes hard to apply such methods on low-source languages due to the absence of corpora/extended corpora (especially annotated one) and Apertium suggests that we apply finite-state transducers that serves as a good solution for machine translation purposes of small languages.


Which of the published tasks are you interested in? What do you plan to do?

I am planning to adopt new language pair to Apertium Guarani - Spanish/Portuguese.


Reasons why Google and Apertium should sponsor it

Guarani is one of the most widely spread indigenous languages of southern South America. It is spoken by 6 million people in Paraguay (where it is one of the official languages), Brazil, Argentina and Bolivia. Guarani translators are present online, but there is no rule-based translator with morphological analysis, which could be more plausible than translators made from Spanish/Portuguese - Guarani parallel corpora. So I believe we can improve the quality of translation by applying rule-based model.

A description of how and who it will benefit in society

The adoption of aforementioned language pair will benefit both Guarani and Spanish/Portuguese speakers, especially in regions where Guarani is represented by small indigenous communities. As a social anthropologist, I conducted a fieldwork in aldeia Boa Vista in São Paulo state, Brazil and the local Guaranis have problems when communicating in Portuguese with local Portuguese-speaking population. Only a part of Guarani Mbya community can communicate fluently in Portuguese (others understand, but cannot communicate normally as they are embarrassed with their pronunciation and lack of Portuguese vocabulary), so this translator would be of a great importance not only to them, but also for other similar communities. It also could alleviate the communication between Indigenous and governmental stuff of the aldeias, who do not have a good command of Guarani.

Guarani-Spanish/Portuguese pair could be used as well by professional linguists, interpreters, philologists and others interested in a topic.

Work Plan

Period Tasks Coverage
Post application period

(27 March - 22 April)

  • Improving knowledge of Guarani (studying grammar, phonetics, morphology);
  • Experiments with writing morphological analyzer;
  • Adding basic phonological rules to FST.
Community Bonding Period

(23 April - 14 May)

  • Studying Apertium Documentation;
  • Exploring .dix and other formats of bilingual dictionary (how they work);
  • Discussing more detailed work plan with mentors (based on the results of Post-Application Period).

30-50%

Stage I. Morphological Analyzer
Week 1

(14 - 20 May)

  • Adding nouns;
  • Writing rules for nouns.

50 - 55%

Week 2

(21 - 27 May)

  • Adding verbs to the lexicon;
  • Writing rules for verbs.

60%

Week 3

(28 May - 3 June)

  • Still working on verbs.

65%

Week 4

(4 - 10 June)

  • Finishing with verbs;
  • Preparing for the first evaluation;
  • Run first tests.

70%

Week 5

(11 - 17 June)

  • Adding adjectives;
  • Writing rules for them;
  • Brushing up morphological analyzer.

75%

Weeks 6

(18 - 24 June)

  • Finishing up monolingual dictionary.

80%

Stage II. Lexical Transfer
Weeks 7 - 10

(25 June - 15 July)

  • Making lexical transfer:
    • Learning and applying lt-proc for bilingual dictionary;
    • Writing transition rules;
  • Preparing for second evaluation (9th of July).

80 - 90%

Weeks 11 - 12

  • Preparing code for the final evaluation.

List your skills and give evidence of your qualifications

I am a graduate B. A. of Social Anthropology and Ethnology, but currently studying Computational Linguistics on M. A. program of National Research University ‘Higher School of Economics’ (Moscow).

Skills: Python (have some experience with Keras, Tensorflow apart from standard Python libraries) , R, some knowledge of SQL, did touch Bash a bit and although I don’t have enough experience in it I am eager to learn .

Experience: Currently involved in educational M. A. project on Popular Science Texts research that includes such NLP tasks as domain-specific named entity recognition, extracting readability metrics, text similarity, text clusterization. Also involved in a project on domain-specific sentiment analysis. Familiar with HFST (did some coursework on finite-state transducer of Chuvash language).

Natural languages: Russian (Native), English (Advanced), Portuguese (Advanced), Spanish and Lithuanian (Intermediate), basic knowledge of Maori (can read).


List any non-Summer-of-Code plans you have for the Summer

1. In June I have summer session university exams (1 - 15 June) approximately, so I won’t be able fully dedicate myself to the task. Probably, I will be able to spend only 15 hours/week for the task.

2. (Probably?) In July I am planning to go to Brazil for 18th summit of International Universal Anthropological and Ethnological Society in Florianopolis (16 - 20 July) during these five days I will be available for 15 hours of coding only, but then I will switch to a normal 40 hours a week, although I am going to stay in Brazil.

3. In August I will probably visit my parents, but it won’t affect the schedule.