Lextor - Revision history

Firespeaker: /* Notes */

2019-03-09T03:22:20Z

Notes

Francis Tyers at 09:18, 21 February 2012

2012-02-21T09:18:24Z

Bech: Documentation in English

2011-09-03T18:34:58Z

Documentation in English

Unhammer at 08:11, 6 January 2010

2010-01-06T08:11:28Z

Francis Tyers at 08:57, 20 May 2009

2009-05-20T08:57:09Z

Francis Tyers: /* Notes */

2009-01-22T08:58:04Z

Notes

Jimregan: /* Use */ clean up some LaTeX stuff

2008-07-26T12:05:57Z

Use: clean up some LaTeX stuff

Francis Tyers: /* Use */

2007-11-25T16:09:20Z

Use

Francis Tyers at 16:06, 25 November 2007

2007-11-25T16:06:40Z

Francis Tyers: /* Pre-processing of the bilingual dictionaries */

2007-08-11T12:46:31Z

Pre-processing of the bilingual dictionaries

@@ Line 200: / Line 200: @@
 # The training of the models used for the lexical selection has been automated in all the packages using it. Furthermore, all the software mentioned has its UNIX manual page
+==References==
+<references/>
 [[Category:Documentation]]

@@ Line 1: / Line 1: @@
-:''This module deals with [[word sense disambiguation]], for more information on the topic, see the [[word sense disambiguation|main page]].''
+:''This module deals with [[lexical selection]], for more information on the topic, see the [[lexical selection|main page]].''
+{{unused}}
-<div style="align: center; border-collapse: collapse; background: #fbfbfb; border: 1px solid #aaa; border-left: 10px solid #1e90ff;">
-&nbsp;&nbsp;This module is currently not used and not under active development.
-</div>
 {{TOCD}}

@@ Line 206: / Line 206: @@
 [[Category:Development]]
 [[Category:Lexical selection]]
+[[Category:Documentation in English]]

@@ Line 90: / Line 90: @@
-Section~\ref{se:preprocessament} next describes the pre-processing
+The next section describes the pre-processing
 that must be done on a bilingual dictionary  containing more than
 one translation per entry (whether the system uses a
-lexical selector or not), and Section~\ref{se:lextor} describes
+lexical selector or not), and [[Lextor#Preprocessing with lexical selection module]] describes
 how the lexical selector works and how it has to be trained.

@@ Line 1: / Line 1: @@
 :''This module deals with [[word sense disambiguation]], for more information on the topic, see the [[word sense disambiguation|main page]].''
+<div style="align: center; border-collapse: collapse; background: #fbfbfb; border: 1px solid #aaa; border-left: 10px solid #1e90ff;">
+&nbsp;&nbsp;This module is currently not used and not under active development.
+</div>
 {{TOCD}}
 When the Apertium system is used to translate between less related

@@ Line 190: / Line 190: @@
 * Source language text (English): '''To get to the city centre'''
-* Lexical selector input: <code>verb!^To<pr>$! \verb!^get<vblex><inf>$! \verb!^to<pr>$! \verb!^the<det><def><sp>$! \verb!^city<n><sg>$! \verb!^centre<n><sg>$!
+* Lexical selector input: <code>^To<pr>$ ^get<vblex><inf>$ ^to<pr>$ ^the<det><def><sp>$ ^city<n><sg>$ ^centre<n><sg>$</code>
 * Translation marks in the en-ca bilingual dictionary for the verb '''get''': <code>rebre</code>, <code>agafar</code>, <code>arribar</code>, <code>aconseguir D</code>
-* Lexical selector output: \verb!^To<pr>$! \verb!^get__arribar<vblex><inf>$! \verb!^to<pr>$! \verb!^the<det><def><sp>$!  \verb!^city<n><sg>$! \verb!^centre<n><sg>$!
+* Lexical selector output: <code>^To<pr>$ ^get__arribar<vblex><inf>$ ^to<pr>$ ^the<det><def><sp>$  ^city<n><sg>$ ^centre<n><sg>$</code>
 ==Notes==

@@ Line 83: / Line 83: @@
 ''full'' or ''fulla'' ("sheet/leaf") and '''muñeca''' &mdash; ''nina'' or ''canell''
 ("doll/wrist"), as well as the <code>en-ca</code> examples shown in page X, where it is described how to specify these multiple equivalents in the bilingual dictionary.
-\begin{figure} {\footnotesize \setlength{\tabcolsep}{0.5mm}
-\begin{center}
-\begin{tabular}{ccccccccc} \\
-\parbox{0.95cm}{source language text} \\ $\downarrow$ \\
-\framebox{\parbox{1.0cm}{de-for\-matter}} $\rightarrow$ &
-\framebox{\parbox{0.6cm}{morph. anal.}}  $\rightarrow$ &
-\framebox{\parbox{1.0cm}{POS tagger}} $\rightarrow$ &
-\framebox{\parbox{0.6cm}{lex. select.}} $\rightarrow$ &
-\framebox{\parbox{0.85cm}{struct. transf.}} $\rightarrow$ &
-\framebox{\parbox{0.6cm}{morph. gen.}}  $\rightarrow$ &
-\framebox{\parbox{1.2cm}{post\-generator}} $\rightarrow$ &
-\framebox{\parbox{1.0cm}{re-for\-matter}} \\ & & & & $\updownarrow$ &
-& & $\downarrow$ \\ & & & & \framebox{\parbox{0.8cm}{lex. transf.}} &
-& &
-\parbox{0.95cm}{target language text} \\
-\end{tabular}
-\end{center} }
-\caption{The nine modules that build the assembly line in the version
-of the machine translation system Apertium.}
-\label{fig:moduls}
-\end{figure}
-Figure~\ref{fig:moduls} shows the new assembly line of the version 2
-of Apertium.\footnote{This figure substitutes the figure
-\ref{fg:modules} in page \pageref{pg:modules} which represents the
-version 1 of Apertium.} \nota{MG: caldria canviar la figura de la
-pàgina 6 per aquesta d'aquí?} The module in charge of the lexical
-selection (lexical selector) runs after the part-of-speech tagger and
-before the structural transfer module; therefore, this new module
-works only with source language information.
@@ Line 200: / Line 168: @@
 to be related. Both corpora must be pre-processed before the
 training. This pre-processing, consisting in analysing the corpora and
-performing the POS disambiguation, can be done  with
+performing the POS disambiguation, can be done  with <code>apertium-preprocess-corpus-lextor</code>
-<code>apertium-prepro\-cess\--cor\-pus\--lex\-tor}.
 The training of the module that performs the lexical selection
-consists of the following tasks:<ref>{{ref|footnote1}} </ref>
+consists of the following tasks:<ref>{{ref|footnote1}}</ref>
 # Obtain the list of words that will be ignored when performing lexical selection ('''stopwords'''). This list can be done manually or using <code>apertium-gen-stopwords-lextor</code>;

@@ Line 136: / Line 136: @@
 compilation, therefore the final user does not need to perform any
 specific action.
 ====Pre-processing without lexical selection module====