Difference between revisions of "IRSTLM"
Jump to navigation
Jump to search
Naan Dhaan (talk | contribs) m (Undo revision 73639 by Naan Dhaan (talk)) Tag: Undo |
Naan Dhaan (talk | contribs) m (Updating installation steps) |
||
| Line 5: | Line 5: | ||
==Installation== |
==Installation== |
||
| + | see https://github.com/irstlm-team/irstlm |
||
| − | |||
| + | or |
||
<pre> |
<pre> |
||
svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm |
svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm |
||
| Line 15: | Line 16: | ||
== Make a language model == |
== Make a language model == |
||
<pre> |
<pre> |
||
| − | + | # only if you specified /path/prefix previously |
|
| + | export PATH=$PATH:/path/prefix/bin |
||
| ⚫ | |||
| + | |||
| ⚫ | |||
</pre> |
</pre> |
||
Revision as of 07:58, 1 August 2021
IRSTLM is a free and open source exact statistical language model using memory-mapping. The language models are compatible with those created with the closed-source SRILM Tooolkit.
See the homepage at https://hlt-mt.fbk.eu/technologies/irstlm
Installation
see https://github.com/irstlm-team/irstlm or
svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm cd irstlm cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/path/prefix make -j4 make install
Make a language model
# only if you specified /path/prefix previously export PATH=$PATH:/path/prefix/bin build-lm.sh -i incorpus.txt -o out.lm.gz -t tmp/
See also
- Moses (includes alternative LM system KenLM)
- Using GIZA++
- RandLM - a randomised LM, based on Bloom Filters
