Building a pseudo-parallel corpus
Revision as of 19:59, 22 August 2012 by Fpetkovski (talk | contribs)
Acquiring parallel corpora can be a difficult process and for some language pairs such resources might not exist. However, we can use a language model for the target language in order to create pseudo-parallel corpora, and use them in the same way as parallel ones.
IRSTLM
IRSTLM is a tool for building n-gram language models from corpora. It supports different smoothing and interpolation methods, including Written-Bell smoothing, Kneser-Ney smoothing and others.
The full documentation can be viewed here, and the whole toolkit can be downloaded here