Apertium has moved from SourceForge to GitHub.
If you have any questions, please come and talk to us on #apertium on irc.freenode.net or contact the GitHub migration team.

Meta-evaluation

From Apertium
(Difference between revisions)
Jump to: navigation, search
Line 1: Line 1:
 
Apertium language modules and translation pairs are subject to the following types of evaluation:
 
Apertium language modules and translation pairs are subject to the following types of evaluation:
   
+
* Morphology coverage / regression testing
  +
* Size of system
  +
** Number of stems in lexc, monodix, bidix
  +
** Number of disambiguation rules
  +
** Number of lexical selection rules
  +
** Number of transfer rules
 
* Naïve coverage
 
* Naïve coverage
 
** Monolingual naïve coverage
 
** Monolingual naïve coverage

Revision as of 00:03, 31 May 2019

Apertium language modules and translation pairs are subject to the following types of evaluation:

  • Morphology coverage / regression testing
  • Size of system
    • Number of stems in lexc, monodix, bidix
    • Number of disambiguation rules
    • Number of lexical selection rules
    • Number of transfer rules
  • Naïve coverage
    • Monolingual naïve coverage
    • Trimmed naïve coverage (i.e., using a trimmed dictionary)
  • Accuracy of analyses
    • Precision/Recall/F-score
  • Accuracy of translation
    • WER/PER/BLEU
  • Clenliness of translation output
    • Testvoc
Personal tools