Difference between revisions of "Apertium-kaz-kir/TODO"

From Apertium
Jump to navigation Jump to search
(Created page with '== By 13 July == * '''add 800 stems''' *: ''mostly nouns, verbs, adjectives (i.e., simple categories)'' ** '''100''' top stems from wikipedia corpus ** '''100''' top stems from r…')
 
(more explicit on WER)
Line 10: Line 10:
 
*** fix the Kyrgyz translation if needed
 
*** fix the Kyrgyz translation if needed
   
* Get WER on <tt>texts/azattyq_24455849.txt</tt> down to around 10%
+
* Start work on WER for <tt>texts/azattyq_24455849.txt</tt>
  +
** Use kaz-kir and output to <tt>texts/azattyq_24455849.kaz-kir.txt</tt>
  +
** Add words/etc. to transducer needed until there are no */#/@
  +
** Copy to <tt>texts/azattyq_24455849.kaz-kir-postedited.txt</tt>
  +
** Post-edit until the postedited Kyrgyz is clean
  +
** Add lexical selection rules and transfer rules as needed
  +
** Goal: get WER down to around 10%
   
 
* Fix the following minor problems:
 
* Fix the following minor problems:

Revision as of 22:28, 8 July 2013

By 13 July

  • add 800 stems
    mostly nouns, verbs, adjectives (i.e., simple categories)
    • 100 top stems from wikipedia corpus
    • 100 top stems from rferl/azattyq corpus
    • 100 top stems from bible corpus
    • 100 top stems from quran corpus
    • any 400 words marked i="yes" in dix
      • sort these into their appropriate sections
      • fix the Kyrgyz translation if needed
  • Start work on WER for texts/azattyq_24455849.txt
    • Use kaz-kir and output to texts/azattyq_24455849.kaz-kir.txt
    • Add words/etc. to transducer needed until there are no */#/@
    • Copy to texts/azattyq_24455849.kaz-kir-postedited.txt
    • Post-edit until the postedited Kyrgyz is clean
    • Add lexical selection rules and transfer rules as needed
    • Goal: get WER down to around 10%
  • Fix the following minor problems:
    • words should not be entered with different capitalisation:
      • құран=куран / Құран=Куран (remove one of them)
      • пайғамбар=пайгамбар / Пайғамбар=Пайгамбар (remove one of them)
    • "шәксіз" is not a Kyrgyz word
    • there's an issue with -ақ; I think we'll need to work on it together