Difference between revisions of "IRSTLM"

From Apertium
Jump to navigation Jump to search
Line 20: Line 20:


==See also==
==See also==
* [[Moses]]
* [[Moses]] (includes alternative LM system KenLM)
* [[Using GIZA++]]
* [[Using GIZA++]]
* [[RandLM]] - a randomised LM, based on [http://en.wikipedia.org/wiki/Bloom_filter Bloom Filters]
* [[RandLM]] - a randomised LM, based on [http://en.wikipedia.org/wiki/Bloom_filter Bloom Filters]

Revision as of 09:02, 29 April 2015

IRSTLM is a free and open source exact statistical language model using memory-mapping. The language models are compatible with those created with the closed-source SRILM Tooolkit.

See the homepage at http://hlt.fbk.eu/en/irstlm


Installation

svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm
cd irstlm
cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/path/prefix
make -j4
make install

Make a language model

export IRSTLM=/path/prefix
$IRSTLM/bin/build-lm.sh -i incorpus.txt -o out.lm.gz -t tmp/

See also