Difference between revisions of "User:Pmodi/GSOC 2020 proposal: Hindi-Punjabi/progress"

From Apertium
Jump to navigation Jump to search
Line 3: Line 3:
==Current task(Community bonding Week 1)==
==Current task(Community bonding Week 1)==
===Finalising Frequency lists & Learning Persian script===
===Finalising Frequency lists & Learning Persian script===
* DONE - Fixed bidirectional translation i.e. pan->hin
* DONE - Frequency lists using WikiExtractor on latest dump.
* DONE - Scraped all Wikipedia texts and made a combined frequency list.
* DONE - Scraped all Wikipedia texts and made a combined frequency list.
* DONE - Frequency lists using WikiExtractor on latest dump.
* IN PROGRESS - Practicing basic understanding of Persian script.
* IN PROGRESS - Practicing basic understanding of Persian script.
* IN PROGRESS - Trying to collect parallel texts to calculate WER.
* IN PROGRESS - Trying to collect parallel texts to calculate WER.
Line 10: Line 11:


==TODO(Next week - Community Bonding Week 2)==
==TODO(Next week - Community Bonding Week 2)==
* Fix bidirectional translation i.e. pan->hin
* Fix transfer rules for postpositions.
* Fix transfer rules for postpositions.
* Start work on function words addition to dictionary.
* Start work on function words addition to dictionary.

Revision as of 19:55, 12 May 2020

Progress on [1]

Current task(Community bonding Week 1)

Finalising Frequency lists & Learning Persian script

  • DONE - Fixed bidirectional translation i.e. pan->hin
  • DONE - Scraped all Wikipedia texts and made a combined frequency list.
  • DONE - Frequency lists using WikiExtractor on latest dump.
  • IN PROGRESS - Practicing basic understanding of Persian script.
  • IN PROGRESS - Trying to collect parallel texts to calculate WER.
  • IN PROGRESS - Extracting stems and suffix/prefix patterns using the frequency lists.

TODO(Next week - Community Bonding Week 2)

  • Fix transfer rules for postpositions.
  • Start work on function words addition to dictionary.

Literature(Apertium Wiki) Covered

  • DONE - Wikipedia Dumps.
  • DONE - Generating Frequency lists.
  • DONE - Building Dictionaries#Monolingual.
  • DONE - Evaluation.