Difference between revisions of "Evalution kaz-tur Machine Translation System"
Jump to navigation
Jump to search
Purplemoon (talk | contribs) |
Purplemoon (talk | contribs) |
||
| Line 5: | Line 5: | ||
{|class="wikitable" |
{|class="wikitable" |
||
|- |
|- |
||
! |
! System !! WER(%) !! PER(%) |
||
|- |
|- |
||
|new-system |
|new-system |
||
Revision as of 15:42, 17 September 2018
The system has been evaluated by measuring the translation quality, the error rate of text produced by the system when comparing with postedited versions of them.
The translation quality was measured using two metrics, the first was word error rate (WER), and the second was position-independent word error rate (PER). Both metrics are based on the Levenshtein distance (Levenshtein, 1965). Metrics based on word error rate were chosen as to be able to compare the system against systems based on similar technology, and to assess the usefulness of the system in a real setting, that is of translating for dissemination.
| System | WER(%) | PER(%) |
|---|---|---|
| new-system | 23.57 | 23.19 |
| old-system | 45.77 | 41.69 |
