Using GIZA++ - Revision history

Unhammer: /* Compiling */

2015-04-29T11:51:02Z

Compiling

2015-04-29T09:02:01Z

2015-04-29T09:00:39Z

Compiling

2015-04-29T08:54:37Z

2015-04-29T08:48:43Z

2015-04-29T08:48:22Z

2015-02-17T19:03:46Z

dead link

2014-10-08T08:34:31Z

Link to French page

2012-03-24T11:25:12Z

Category:Documentation in English

2009-07-15T19:16:58Z

Usage

@@ Line 15: / Line 15: @@
 cp GIZA++-v2/trainGIZA++.sh /path/prefix/bin/
 cp mkcls-v2/mkcls /path/prefix/bin/
-# /path/prefix/bin is -external-bin-dir to moses
 </pre>
+The /path/prefix/bin is what you use as -external-bin-dir to moses, e.g. <code>perl train-model.perl -external-bin-dir /path/prefix/bin</code>
 ===Troubleshooting===

@@ Line 2: / Line 2: @@
 {{TOCD}}
-'''GIZA++''' is a program for aligning words and sequences of words in sentence aligned corpora. If you have parallel corpus you can use GIZA++ to make bilingual dictionaries for Apertium (e.g. using [[ReTraTos]]).
+'''GIZA++''' is a program for aligning words and sequences of words in sentence aligned corpora. If you have parallel corpus you can use GIZA++ to make bilingual dictionaries for Apertium (e.g. using [[ReTraTos]]) or [[lexical selection]] rules.
 ==Compiling==

@@ Line 9: / Line 9: @@
 cd giza-pp
 make
+cp GIZA++-v2/GIZA++ /path/prefix/bin/
+cp GIZA++-v2/plain2snt.out /path/prefix/bin/
+cp GIZA++-v2/snt2cooc.out /path/prefix/bin/
+cp GIZA++-v2/snt2plain.out /path/prefix/bin/
+cp GIZA++-v2/trainGIZA++.sh /path/prefix/bin/
+cp mkcls-v2/mkcls /path/prefix/bin/
+# /path/prefix/bin is -external-bin-dir to moses
 </pre>
+===Troubleshooting===
-Note: if you're running a case-insensitive file system (typical for Mac OS) you'll have to edit the file <code>model3.cpp</code> before compiling, since it outputs two files named <code>foo.a3.final</code> and <code>foo.A3.final</code>. So before compiling, change eg. lines 321--322:
+If you're running a case-insensitive file system (typical for Mac OS) you'll have to edit the file <code>model3.cpp</code> before compiling, since it outputs two files named <code>foo.a3.final</code> and <code>foo.A3.final</code>. So before compiling, change eg. lines 321--322:
 <pre>
       alignfile = Prefix + ".A3." + number ;

@@ Line 5: / Line 5: @@
 ==Compiling==
+<pre>
-[http://code.google.com/p/giza-pp/ Download] and compile GIZA++.
+git clone https://github.com/moses-smt/giza-pp
+cd giza-pp
+make
+</pre>
 Note: if you're running a case-insensitive file system (typical for Mac OS) you'll have to edit the file <code>model3.cpp</code> before compiling, since it outputs two files named <code>foo.a3.final</code> and <code>foo.A3.final</code>. So before compiling, change eg. lines 321--322:

@@ Line 93: / Line 93: @@
 *[[ReTraTos]]
 *[[Moses]]
-*[[mgiza]] – a more recent alternative to Giza++
+*[[Mgiza]] – a more recent alternative to Giza++
 *[[Learning rules from parallel and non-parallel corpora]] using Giza to make lex-sel rules

@@ Line 95: / Line 95: @@
 ==External links==
-* [http://guardiani.us/index.php/Moses_Language_Model_Howto_v2 Moses Language Model Howto v2]
 * [http://www.statmt.org/moses/?n=FactoredTraining.HomePage statmt.org: Factored training]

← Older revision		Revision as of 11:25, 24 March 2012
Line 97:		Line 97:

	[[Category:Documentation]]		[[Category:Documentation]]
			[[Category:Documentation in English]]

@@ Line 2: / Line 2: @@
 '''GIZA++''' is a program for aligning words and sequences of words in sentence aligned corpora. If you have parallel corpus you can use GIZA++ to make bilingual dictionaries for Apertium (e.g. using [[ReTraTos]]).
-==Usage==
+==Compiling==
+[http://code.google.com/p/giza-pp/ Download] and compile GIZA++.
-Download your corpus, and convert into one sentence per line.
-Download and compile GIZA++.
 Note: if you're running a case-insensitive file system (typical for Mac OS) you'll have to edit the file <code>model3.cpp</code> before compiling, since it outputs two files named <code>foo.a3.final</code> and <code>foo.A3.final</code>. So before compiling, change eg. lines 321--322:
@@ Line 17: / Line 15: @@
       test_alignfile = Prefix + ".tst.AA3." + number ;
 </pre>
+==Usage==
+Download your corpus, and convert into one sentence per line.
 Use <code>plain2snt.out</code> to convert your corpus into GIZA++ format: