Difference between revisions of "IRSTLM"

From Apertium
Jump to navigation Jump to search
m (Undo revision 73639 by Naan Dhaan (talk))
Tag: Undo
m (Updating installation steps)
Line 5: Line 5:


==Installation==
==Installation==
see https://github.com/irstlm-team/irstlm

or
<pre>
<pre>
svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm
svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm
Line 15: Line 16:
== Make a language model ==
== Make a language model ==
<pre>
<pre>
export IRSTLM=/path/prefix
# only if you specified /path/prefix previously
export PATH=$PATH:/path/prefix/bin
$IRSTLM/bin/build-lm.sh -i incorpus.txt -o out.lm.gz -t tmp/

build-lm.sh -i incorpus.txt -o out.lm.gz -t tmp/
</pre>
</pre>



Revision as of 07:58, 1 August 2021

IRSTLM is a free and open source exact statistical language model using memory-mapping. The language models are compatible with those created with the closed-source SRILM Tooolkit.

See the homepage at https://hlt-mt.fbk.eu/technologies/irstlm


Installation

see https://github.com/irstlm-team/irstlm or

svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm
cd irstlm
cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/path/prefix
make -j4
make install

Make a language model

# only if you specified /path/prefix previously
export PATH=$PATH:/path/prefix/bin

build-lm.sh -i incorpus.txt -o out.lm.gz -t tmp/

See also