Difference between revisions of "User:Pmodi/GSOC 2020 proposal: Hindi-Punjabi/progress"
Jump to navigation
Jump to search
(One intermediate revision by the same user not shown) | |||
Line 4: | Line 4: | ||
===Finalising Frequency lists & Learning Persian script=== |
===Finalising Frequency lists & Learning Persian script=== |
||
* DONE - Frequency lists using WikiExtractor on latest dump. |
* DONE - Frequency lists using WikiExtractor on latest dump. |
||
− | * DONE - |
+ | * DONE - Scraped all Wikipedia texts and made a combined frequency list. |
− | * IN PROGRESS - Finish scraping more texts and merge results with the current freq. list. |
||
* IN PROGRESS - Practicing basic understanding of Persian script. |
* IN PROGRESS - Practicing basic understanding of Persian script. |
||
+ | * IN PROGRESS - Trying to collect parallel texts to calculate WER. |
||
− | |||
+ | * IN PROGRESS - Extracting stems and suffix/prefix patterns using the frequency lists. |
||
==TODO(Next week - Community Bonding Week 2)== |
==TODO(Next week - Community Bonding Week 2)== |
||
Line 13: | Line 13: | ||
* Fix transfer rules for postpositions. |
* Fix transfer rules for postpositions. |
||
* Start work on function words addition to dictionary. |
* Start work on function words addition to dictionary. |
||
+ | |||
+ | ==Literature(Apertium Wiki) Covered== |
||
+ | * DONE - Wikipedia Dumps. |
||
+ | * DONE - Generating Frequency lists. |
||
+ | * DONE - Building Dictionaries#Monolingual. |
||
+ | * DONE - Evaluation. |
Revision as of 20:33, 11 May 2020
Progress on [1]
Contents
Current task(Community bonding Week 1)
Finalising Frequency lists & Learning Persian script
- DONE - Frequency lists using WikiExtractor on latest dump.
- DONE - Scraped all Wikipedia texts and made a combined frequency list.
- IN PROGRESS - Practicing basic understanding of Persian script.
- IN PROGRESS - Trying to collect parallel texts to calculate WER.
- IN PROGRESS - Extracting stems and suffix/prefix patterns using the frequency lists.
TODO(Next week - Community Bonding Week 2)
- Fix bidirectional translation i.e. pan->hin
- Fix transfer rules for postpositions.
- Start work on function words addition to dictionary.
Literature(Apertium Wiki) Covered
- DONE - Wikipedia Dumps.
- DONE - Generating Frequency lists.
- DONE - Building Dictionaries#Monolingual.
- DONE - Evaluation.