Multi-engine translation synthesiser

The idea of this project is to take advantage of all possible resources in creating MT systems for marginalised languages. The general idea is to use the output of various MT systems to produce one "better" translation. The "baseline" would be to use Apertium and Moses.

Code at https://apertium.svn.sourceforge.net/svnroot/apertium/trunk/apertium-combine

Principles

• Make maximum usage of available resources for marginalised languages. Parallel corpora, user-feedback, other translation systems.
• Integrate seamlessly into the Apertium pipeline.
• Be modular, it should work with Moses, but any other source of translations / phrases should be also considered.

Ideas

Statistical post-edition

This idea is kind of like the TMX support in Apertium, only it goes at the end of the pipeline.

• The first approximation would be to
  • Take a parallel corpus, for e.g. Welsh--English, then run the Welsh side through Apertium to get English(MT)—English phrase table.
  • Make a program that goes at the end of the pipeline that for n-gram segments (what SMT people call "phrases") looks them up in the phrase table.
  • If it finds a matching phrase, it scores both on a language model and chooses the highest probability.
  • This idea can be extended by incorporating user-feedback. For example a user "post-edits a phrase" and you can add these phrases to the phrase table at a given probability.
  • Could also help by resolving some unknown words.

The format would be something like:

$ echo "This is a [<em>]test[<\/em>] of the automatic translation system" | apertium-phrase-lookup phrase-table.0-0,2 
This is a [<em>]{test|proof}[<\/em>] of the {automatic translation|machine translation} system.

$ echo "This is a [<em>]test[<\/em>] of the automatic translation system" | apertium-phrase-lookup phrase-table.0-0,2  | apertium-ranker en.blm
This is a [<em>]test[<\/em>] of the machine translation system.

Issues:

Speed — language models and phrase tables are slow, but we can discard lots Apertium translates at ~3,000 words/sec, we'll want to see how we can translate at least at ~1,000 words/sec. We can probably do with having a much smaller language model than required by SMT, partially because we have more of an idea that the output "should" be correct, regardless of the statistics. For example that the translation in the bilingual dictionary is already the most frequent or most general.

Why this is good:

For languages like Welsh and Breton where there isn't a lot of parallel text, but there is some, we can take advantage of it. We can also take advantage of user improvements without having to improve the language pair directly.

Multi-engine pipeline

This would have two or three extra programs in the pipeline. The first (apertium-collector) would probably sit after the deformatter and would 'collect' segments naïvely, clipping on <sent> and passing them on to the other MT engines. The second (apertium-combiner) would sit after post-generation and take the Apertium output and the output from the translations got with the apertium-collector, and synthesise the best possible translation.

Sample

• Input sentence: Fe fyddai un o bob pedwar o rieni Cymru yn caniatáu i'w plant gael ffôn symudol cyn iddyn nhw fod yn 10 oed, yn ôl arolwg.
  • Apertium: one would be of each four parents Wales allowing to its children get mobile phone before to them be in 10 years old, according to survey. (69% WER)
  • Moses: i would be one in four of parents in wales to allow it to children before they get mobile phone them that is 10 years , ago arolwg. (75% WER)
• Best synthesis: Would be one in four parents in Wales allowing to its children get mobile phone before them be 10 years old, according to survey. (58% WER)
• Reference: One in four parents in Wales would allow their children to get a mobile phone before the age of 10, according to a survey.

The format would be something like:

$ echo "Fe fyddai un o bob <em>pedwar</em> o rieni Cymru yn caniatáu i'w plant gael ffôn symudol cyn iddyn nhw fod yn 10 oed, yn ôl arolwg." | \ 
  apertium-destxt | apertium-collector -e moses | lt-proc ... | cg-proc ...rest of pipeline... | lt-proc -g ... | apertium-combiner | \ 
  apertium-ranker en.blm

References

• Johnson, J.H., Martin, J., Foster, G., and Kuhn, R. (2007) "Improving Translation Quality by Discarding Most of the Phrasetable". Proceedings of EMNLP. 2007. NRC 49348.