Difference between revisions of "Translation quality statistics"

From Apertium
Jump to navigation Jump to search
(doh, WER/BLEU was from 0.6.1)
Line 4: Line 4:
 
! Translator !! Date !! Version !! Direction !! WER !! PWER !! BLEU !! Reference
 
! Translator !! Date !! Version !! Direction !! WER !! PWER !! BLEU !! Reference
 
|-
 
|-
|rowspan=2| <code>apertium-nn-nb</code> ||rowspan=2|12th October 2009||rowspan=2| 0.6.5 || nn → nb || 32.5%, 17.7% || - || 0.74 ||rowspan=2| Unhammer and Trosterud, 2009
+
|rowspan=2| <code>apertium-nn-nb</code> ||rowspan=2|12th October 2009||rowspan=2| 0.6.1 || nn → nb || 32.5%, 17.7% || - || 0.74 ||rowspan=2| Unhammer and Trosterud, 2009
 
|-
 
|-
 
| nb → nn || - || - || -
 
| nb → nn || - || - || -

Revision as of 15:42, 29 March 2010

This page aims to give an overview of the quality of various translators available in the Apertium platform. Word Error Rate (WER) and Position-independent Word Error Rate (PWER) are measures of post-edition effort. The number gives the expected number of words needed to be corrected in 100 words of running text. So, a WER of 4.7% indicates that in a given 100 words of text, 4.7 of them will need to be corrected by the post-editor.

Translator Date Version Direction WER PWER BLEU Reference
apertium-nn-nb 12th October 2009 0.6.1 nn → nb 32.5%, 17.7% - 0.74 Unhammer and Trosterud, 2009
nb → nn - - -
apertium-sv-da 12th Oct 2009 0.5.0 sv → da 30.3 % 27.7 % - http://wiki.apertium.org/w/index.php?title=Swedish_and_Danish/Evaluation&oldid=14881
da → sv - - -
apertium-eu-es 2nd September 2009 eu → es 72.4 % 39.8 % - Ginestí-Rosell et al., 2009
es → eu - - -
apertium-cy-en 2nd January 2009 cy → en 55.7 % 30.5 % - Tyers and Donnelly, 2009
en → cy - - -
apertium-eo-en 08 May 2009 0.9.0 en → eo 21.0 % 19.0 % - http://wiki.apertium.org/w/index.php?title=English_and_Esperanto/Evaluation&oldid=12418
eo → en - - -
apertium-es-pt 15th May 2006 es → pt 4.7 % - - Armentano et al., 2006
pt → es 11.3 % - -
apertium-oc-ca 10th May 2006 oc → ca 9.6 % - - Armentano and Forcada, 2006
ca → oc - - -
apertium-pt-ca 28th July 2008 pt → ca 16.6% - - Armentano and Forcada, 2008
ca → pt 14.1% - -
apertium-en-es May 2009 en → es - - 18.51 Sánchez-Martínez, 2009
es → en - - 18.81


References