Moses

En français

Requisites

• GIZA++ and mkcls (git clone https://github.com/moses-smt/giza-pp)
• Moses (git clone git@github.com:moses-smt/mosesdecoder.git)
• IRST LM (svn checkout svn://svn.code.sf.net/p/irstlm/code/trunk irstlm)

Compiling

See also: Using GIZA++

GIZA++

tar -xzvf giza-pp-v1.0.2.tar.gz
cd giza-pp
make
cp mkcls-v2/mkcls /path/prefix/bin
cp GIZA++-v2/GIZA++ /path/prefix/bin
cp GIZA++-v2/plain2snt.out /path/prefix/bin
cp GIZA++-v2/snt2cooc.out /path/prefix/bin
cp GIZA++-v2/snt2plain.out /path/prefix/bin
cp GIZA++-v2/trainGIZA++.sh /path/prefix/bin
cd ..

Moses

cd trunk
./regenerate-makefiles.sh
./configure --prefix=/path/prefix
make
make install
cd scripts/training/symal
make
cp symal giza2bal.pl /path/prefix/bin
cd ../../../
cd scripts/training/phrase-extract
make
cp extract score /path/prefix/bin
cd ../../../

Now edit the file scripts/training/train-factored-phrase-model.perl and change the following lines:

my $SCRIPTS_ROOTDIR = "/home/fran/source/moses/trunk/scripts/";

...

# the following line is set installation time by 'make release'.  BEWARE!
my $BINDIR="/path/prefix/bin";

cp scripts/training/train-factored-phrase-model.perl /path/prefix/bin/
cp scripts/training/symal/giza2bal.pl /path/prefix/bin/

cd ..

IRSTLM

cd irstlm
cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/path/prefix
make -j4
make install

Building language model

export IRSTLM=/path/prefix
build-lm.sh -i cy.crp.txt -o cy.lm.gz -t /tmp

Troubleshooting

do
export PYTHONIOENCODING=utf-8
before running train-model.perl (or fix merge_alignments.py yourself)

See also

• Using GIZA++

External links

• WMT08 Baseline system