https://wiki.apertium.org/w/index.php?action=history&feed=atom&title=Meta-evaluation 2026-05-29T19:11:00Z Revision history for this page on the wiki MediaWiki 1.34.1 https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69840&oldid=prev 2019-06-01T02:32:14Z

<p><span dir="auto"><span class="autocomment">Translation accuracy</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 02:32, 1 June 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 30:</td> <td colspan="2" class="diff-lineno">Line 30:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Translation accuracy ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Translation accuracy ==</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>[[apertium-eval-translator.pl]] and [[apertium-eval-translator-line.pl]] work well but are a bit old, and could probably benefit from being rewritten in python</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div><ins class="diffchange diffchange-inline">* WER/PER: </ins>[[apertium-eval-translator.pl]] and [[apertium-eval-translator-line.pl]] work well but are a bit old, and could probably benefit from being rewritten in python</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* BLEU: nothing existing</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Regression testing: we have some once-off scripts for this?</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Translation cleanliness ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Translation cleanliness ==</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69836&oldid=prev 2019-05-31T20:55:49Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 20:55, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 14:</td> <td colspan="2" class="diff-lineno">Line 14:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Precision/Recall/F-score</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Precision/Recall/F-score</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Accuracy of translation</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Accuracy of translation</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>** Overall accuracy (over<del class="diffchange diffchange-inline"> small</del> parallel corpora): WER/PER/BLEU</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>** Overall accuracy (over parallel corpora): WER/PER/BLEU</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Regression tests (pairs of phrases or sentences)</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Regression tests (pairs of phrases or sentences)</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Cleanliness of translation output</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Cleanliness of translation output</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69835&oldid=prev 2019-05-31T20:55:38Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 20:55, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 14:</td> <td colspan="2" class="diff-lineno">Line 14:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Precision/Recall/F-score</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Precision/Recall/F-score</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Accuracy of translation</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Accuracy of translation</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>** WER/PER/BLEU</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>**<ins class="diffchange diffchange-inline"> Overall accuracy (over small parallel corpora):</ins> WER/PER/BLEU</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>** Regression tests</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>** Regression tests<ins class="diffchange diffchange-inline"> (pairs of phrases or sentences)</ins></div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Cleanliness of translation output</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Cleanliness of translation output</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Testvoc</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Testvoc</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69834&oldid=prev 2019-05-31T20:54:48Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 20:54, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 15:</td> <td colspan="2" class="diff-lineno">Line 15:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Accuracy of translation</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Accuracy of translation</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** WER/PER/BLEU</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** WER/PER/BLEU</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>** Regression tests</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Cleanliness of translation output</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Cleanliness of translation output</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Testvoc</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Testvoc</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69833&oldid=prev 2019-05-31T18:30:29Z

<p>floating TOC</p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 18:30, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>&lt;div style="float: right;"&gt;__TOC__&lt;/div&gt;</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>Apertium language modules and translation pairs are subject to the following types of evaluation:</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>Apertium language modules and translation pairs are subject to the following types of evaluation:</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69832&oldid=prev 2019-05-31T18:28:53Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 18:28, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 10:</td> <td colspan="2" class="diff-lineno">Line 10:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Monolingual naïve coverage</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Monolingual naïve coverage</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Trimmed naïve coverage (i.e., using a trimmed dictionary)</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Trimmed naïve coverage (i.e., using a trimmed dictionary)</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>* Accuracy of <del class="diffchange diffchange-inline">analyses</del></div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Accuracy of <ins class="diffchange diffchange-inline">analyser</ins></div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Precision/Recall/F-score</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Precision/Recall/F-score</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Accuracy of translation</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Accuracy of translation</div></td> </tr> <tr> <td colspan="2" class="diff-lineno">Line 29:</td> <td colspan="2" class="diff-lineno">Line 29:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Translation accuracy ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Translation accuracy ==</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[apertium-eval-translator.pl]] and [[apertium-eval-translator-line.pl]] work well but are a bit old, and could probably benefit from being rewritten in python</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[apertium-eval-translator.pl]] and [[apertium-eval-translator-line.pl]] work well but are a bit old, and could probably benefit from being rewritten in python</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><br /></td> <td colspan="2" class="diff-empty diff-side-added"></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Translation cleanliness ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Translation cleanliness ==</div></td> </tr> <tr> <td colspan="2" class="diff-lineno">Line 37:</td> <td colspan="2" class="diff-lineno">Line 36:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* prefixed morphology expansion testvoc ("testvoc lite")</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* prefixed morphology expansion testvoc ("testvoc lite")</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* corpus testvoc</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* corpus testvoc</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>[[Category:Evaluation]]</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>[[Category:Quality control]]</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69831&oldid=prev 2019-05-31T18:27:22Z

<p><span dir="auto"><span class="autocomment">Translation cleanliness</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 18:27, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 33:</td> <td colspan="2" class="diff-lineno">Line 33:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Translation cleanliness ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Translation cleanliness ==</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>There are several ways to test translation cleanliness<del class="diffchange diffchange-inline">.</del> <del class="diffchange diffchange-inline">From</del> <del class="diffchange diffchange-inline">simplest</del> <del class="diffchange diffchange-inline">to</del> <del class="diffchange diffchange-inline">most</del> <del class="diffchange diffchange-inline">involved</del>:</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>There are several ways to test translation cleanliness <ins class="diffchange diffchange-inline">that</ins> <ins class="diffchange diffchange-inline">are</ins> <ins class="diffchange diffchange-inline">good</ins> <ins class="diffchange diffchange-inline">for</ins> <ins class="diffchange diffchange-inline">different</ins> <ins class="diffchange diffchange-inline">purposes</ins>:</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* morphology expansion testvoc ("standard testvoc")</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* morphology expansion testvoc ("standard testvoc")</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* prefixed morphology expansion testvoc ("testvoc lite")</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* prefixed morphology expansion testvoc ("testvoc lite")</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69830&oldid=prev 2019-05-31T18:26:14Z

<p><span dir="auto"><span class="autocomment">Morphology coverage</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 18:26, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 19:</td> <td colspan="2" class="diff-lineno">Line 19:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Morphology coverage ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Morphology coverage ==</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>The tools we have for this are &lt;code&gt;aq-morftest&lt;/code&gt; from [[Apertium quality]] and [[morph-test.py]].</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>The tools we have for this are &lt;code&gt;aq-morftest&lt;/code&gt; from [[Apertium quality]] and [[morph-test.py]].</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>Two complaints: they don't support directionality restrictions on tests, and they don't return error codes.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Naïve coverage ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Naïve coverage ==</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69829&oldid=prev 2019-05-31T18:24:40Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 18:24, 31 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 14:</td> <td colspan="2" class="diff-lineno">Line 14:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Accuracy of translation</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Accuracy of translation</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** WER/PER/BLEU</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** WER/PER/BLEU</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>* <del class="diffchange diffchange-inline">Clenliness</del> of translation output</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* <ins class="diffchange diffchange-inline">Cleanliness</ins> of translation output</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>** Testvoc</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>** Testvoc</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=Meta-evaluation&diff=69828&oldid=prev 2019-05-30T23:55:34Z

<p><span dir="auto"><span class="autocomment">Translation cleanliness</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 23:55, 30 May 2019</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 32:</td> <td colspan="2" class="diff-lineno">Line 32:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>There are several ways to test translation cleanliness. From simplest to most involved:</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>There are several ways to test translation cleanliness. From simplest to most involved:</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>* morphology expansion testvoc</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* morphology expansion testvoc<ins class="diffchange diffchange-inline"> ("standard testvoc")</ins></div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* prefixed morphology expansion testvoc ("testvoc lite")</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* corpus testvoc</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* corpus testvoc</div></td> </tr> </table>

Firespeaker