Difference between revisions of "Meta-evaluation"

From Apertium
Jump to navigation Jump to search
(Created page with "Apertium language modules and translation pairs are subject to the following types of evaluation: * Naïve coverage ** Trimmed naïve coverage (i.e., using a trimmed diction...")
 
m
Line 3: Line 3:


* Naïve coverage
* Naïve coverage
** Monolingual naïve coverage
** Trimmed naïve coverage (i.e., using a trimmed dictionary)
** Trimmed naïve coverage (i.e., using a trimmed dictionary)
* Accuracy of tagging/disambiguation
* Accuracy of tagging/disambiguation

Revision as of 22:01, 30 May 2019

Apertium language modules and translation pairs are subject to the following types of evaluation:


  • Naïve coverage
    • Monolingual naïve coverage
    • Trimmed naïve coverage (i.e., using a trimmed dictionary)
  • Accuracy of tagging/disambiguation
    • Precision/Recall/F-score
  • Accuracy of translation
    • WER/PER/BLEU
  • Clenliness of translation output
    • Testvoc