ReTraTos - Revision history

Unhammer: /* External links */

2024-05-03T09:32:03Z

External links

2024-05-03T08:11:22Z

urls

2024-05-03T08:10:33Z

2014-10-06T09:42:40Z

Link to French page

2014-10-06T09:42:06Z

izing -> ising

2012-03-24T10:22:59Z

Category:Documentation in English

2009-07-25T15:12:14Z

Tagging the corpus: remove NL ambiguity

2009-07-25T15:11:49Z

Tagging the corpus: formatting tip

2008-03-31T07:51:17Z

Aligning the corpus

2008-03-30T16:11:40Z

Running ReTraTos_lex

@@ Line 147: / Line 147: @@
 * [http://www.nilc.icmc.usp.br/nilc/projects/retratos.htm ReTraTos: Homepage]
 * [http://retratos.svn.sourceforge.net/viewvc/retratos/ ReTraTos: SVN]
+* [https://github.com/apertium/ReTraTos ReTraTos: github archive of the SVN]
 ==Further reading==

← Older revision		Revision as of 08:11, 3 May 2024
Line 151:		Line 151:

	* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "[https://www.dlsi.ua.es/gent/mlf/docum/caseli08.pdf From free shallow monolingual resources to machine translation systems: easing the task]", in ''Mixing Approaches To Machine Translation'', MATMT2008, proceedings (Donostia, Spain, Feb. 14, 2008), pp. 41--48		* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "[https://www.dlsi.ua.es/gent/mlf/docum/caseli08.pdf From free shallow monolingual resources to machine translation systems: easing the task]", in ''Mixing Approaches To Machine Translation'', MATMT2008, proceedings (Donostia, Spain, Feb. 14, 2008), pp. 41--48
	* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "Automatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation". ''Machine Translation'' ~~(to appear)~~		* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "[https://www.dlsi.ua.es/gent/mlf/docum/caseli08j.pdf Automatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation]". ''Machine Translation''

@@ Line 150: / Line 150: @@
 ==Further reading==
-* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "[http://www.dlsi.ua.es/~mlf/docum/caseli08p.pdf From free shallow monolingual resources to machine translation systems: easing the task]", in ''Mixing Approaches To Machine Translation'', MATMT2008, proceedings (Donostia, Spain, Feb. 14, 2008), pp. 41--48
+* Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "[https://www.dlsi.ua.es/gent/mlf/docum/caseli08.pdf From free shallow monolingual resources to machine translation systems: easing the task]", in ''Mixing Approaches To Machine Translation'', MATMT2008, proceedings (Donostia, Spain, Feb. 14, 2008), pp. 41--48
 * Helena M. Caseli, Maria das Graças V. Nunes, Mikel L. Forcada. (2008) "Automatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation". ''Machine Translation'' (to appear)

@@ Line 1: / Line 1: @@
 {{TOCD}}
 '''ReTraTos''' is a toolbox to build linguistic resources useful for machine translation (MT): bilingual dictionaries and transfer rules. The induction systems and open linguistic data can be used with the [[Apertium]] toolbox to build open-source MT systems.
@@ Line 108: / Line 110: @@
         Generating target-source dictionary ... OK
         Processing bilingual dictionary ... OK
-        Generalizing bilingual dictionary ... OK
+        Generalising bilingual dictionary ... OK
         Cleaning equal attributes ... OK

← Older revision		Revision as of 10:22, 24 March 2012
Line 153:		Line 153:

	[[Category:Tools]]		[[Category:Tools]]
			[[Category:Documentation in English]]

@@ Line 62: / Line 62: @@
 </pre>
-This'll save you lots of time later on... oh, and also just remove any lines that don't have at least one <code>^foo<bar>$</code> sequence in them (eg. a single alignment of '%' to '%', or something).
+This'll save you lots of time later on... oh, and you should also just remove any lines that don't have at least one <code>^foo<bar>$</code> sequence in them (eg. a single alignment of '%' to '%', or something).
 ===Aligning the corpus===

@@ Line 52: / Line 52: @@
 de<pr> desarrollo<n><m><sg> ;<sent>
 </pre>
+ReTraTos is very picky about formatting, so before removing '^' and '$' you might want to just remove anything that's ''not'' contained within '^' and '$', ie. something like
+<pre>
+# ^foo$-^bar$ => ^foo$ ^bar$     -^foo$ => ^foo$           ^bar$- => ^bar$
+sed 's%\$[^^]*\^%\$ \^%g'    | sed  's%^[^^]*\^%\^%g' | sed 's%\$[^^]*$%\$%g' |\
+# remove '^' and '$'
+sed 's%[$^]% %g'
+</pre>
+This'll save you lots of time later on... oh, and also just remove any lines that don't have at least one <code>^foo<bar>$</code> sequence in them (eg. a single alignment of '%' to '%', or something).
 ===Aligning the corpus===

@@ Line 68: / Line 68: @@
 beneficioso<adj><m><sg>:8 *cooperar:9 mediante<pr>:10 el<det><def><m><sg>:11 establecimiento<n><m><sg>:12 de<pr>:0 uno<det><ind><m><sg>:13
 programa<n><m><sg>:14 común<adj><mf><sg>:15 de<pr>:16 investigación<n><f><pl>:17 y<cnjcoo>:18 de<pr>:19 desarrollo<n><m><sg>:20 ;<sent>:0</s>
+</pre>
+In order to use ReTraTos, the surface forms of each lexical unit need to be re-added so that the above example looks like the following:
+<pre>
+<s snum=6>Reconociendo/Reconocer<vblex><ger>:1 que/que<cnjsub>:0 ,/,<cm>:0 en/en<pr>:2 particular/particular<adj><mf><sg>:3 ,/,<cm>:0
+sería/ser<vbser><cni><p3><sg>:5 mutuamente/mutuamente<adv>:7 beneficioso/beneficioso<adj><m><sg>:8 *cooperar/*cooperar:9 mediante/mediante<pr>:10
+el/el<det><def><m><sg>:11 establecimiento/establecimiento<n><m><sg>:12 de/de<pr>:0 un/uno<det><ind><m><sg>:13 programa/programa<n><m><sg>:14
+común/común<adj><mf><sg>:15 de/de<pr>:16 investigaciones/investigación<n><f><pl>:17 y/y<cnjcoo>:18 de/de<pr>:19 desarollo/desarrollo<n><m><sg>:20
+;<sent>:0</s>
 </pre>

@@ Line 96: / Line 96: @@
 The output file will be the <code>.dix</code> file.
+===Troubleshooting===
+;Wrongly tagged
+If you are getting many messages like this, or even just one, it means that there is an error in one of your alignment files.
+<pre>
+WARNING: (Entrada::le_sentenca): String O<cnjcoo>.<sent>V<num><mf><pl> is wrongly tagged
+WARNING: (Entrada::le_sentenca): String )<rpar>.<sent> is wrongly tagged
+WARNING: (Entrada::le_sentenca): String a<pr>)<rpar> is wrongly tagged
+WARNING: (Entrada::le_sentenca): String 1991<num>.<sent> is wrongly tagged
+...
+</pre>
+The alignments in the files must be in the format of <code>lemma<tags>:<alignment></code>, e.g. <code>1991<num>:1</code> or <code>pero<cnjcoo>:2</code>.  Forbidden are the alignments which have random strings between tags, e.g. <code>O<cnjcoo>.<sent>V<num><mf><pl></code> is a set of three lemma/tag pairs with the same alignment. Probably the punctuation has not been separated out correctly from the text with spaces.
+It is possible to fix this manually, by going in and either removing punctuation, or inserting spaces and null-alignments, but it might be better if there are many warning messages to re-process the corpus.
 ==See also==