Shardulc: GitHub migration

2018-03-10T02:24:45Z

GitHub migration

Francis Tyers at 11:32, 29 January 2016

2016-01-29T11:32:45Z

Francis Tyers: Created page with "Here is an example of how to lemmatise using apertium-swe. Install: * Lttoolbox * Apertium * VISLCG

 svn co https://svn.code.sf.net/p/apertium/svn/languages/aperti..."

2016-01-29T11:25:47Z

Created page with "Here is an example of how to lemmatise using apertium-swe. Install: * Lttoolbox * Apertium * VISLCG <pre> svn co https://svn.code.sf.net/p/apertium/svn/languages/aperti..."

New page

Here is an example of how to lemmatise using [[apertium-swe]].

Install:

* Lttoolbox
* Apertium
* VISLCG

<pre>
svn co https://svn.code.sf.net/p/apertium/svn/languages/apertium-swe
</pre>
edit file apertium-swe.swe.dix and decomment the "guesser" section

<pre>
./configure
make
</pre>

To morphologically analyse:
<pre>
$ echo "Den här är en test." | apertium -d . swe-disam
</pre>
There will be a lot of ambiguity. A simple CG file will reduce this by removing the guessed analyses where there is an analysis in the lexicon:
<pre>
LIST Guess = guess ;

SECTION

REMOVE Guess ;
</pre>
You can save this to a file "guesser.cg3" and run it so:
<pre>
$ echo "Den här är en test." | apertium -d . swe-disam | vislcg3 --grammar guesser.cg3
</pre>
Other kind of output formats:

First compile the CG file:
<pre>
$ cg-comp guesser.cg3 guesser.bin
</pre>
Then you can use the guesser format using one line:
<pre>
$ echo "Den här är en test." | apertium -d . swe-tagger | cg-proc guesser.bin
</pre>
Something like:
<pre>
$ echo "Den här är en test." | apertium -d . swe-tagger | cg-proc guesser.bin | sed 's/<[^>]\+>//g' | cg-proc -n guesser.bin
</pre>
Will give lemmatised output where the tokens are encased in ^ and $, and ambiguous stems/lemmas are given separated by '/'

If you want to pick just the first one and have unambiguous output, you can try:
<pre>
$ echo "Den här är en test." | apertium -d . swe-tagger | cg-proc guesser.bin |\
sed 's/<[^>]\+>//g' | cg-proc -n guesser.bin | sed 's/\/[^\$]\+\$/$/g'
</pre>

[[Category:Tools]]

Lemmatisation - Revision history

Shardulc: GitHub migration

Francis Tyers at 11:32, 29 January 2016

Francis Tyers: Created page with "Here is an example of how to lemmatise using apertium-swe. Install: * Lttoolbox * Apertium * VISLCG
svn co https://svn.code.sf.net/p/apertium/svn/languages/aperti..."

@@ Line 8: / Line 8: @@
 <pre>
-svn co https://svn.code.sf.net/p/apertium/svn/languages/apertium-swe
+git clone https://github.com/apertium/apertium-swe.git
 </pre>
 edit file apertium-swe.swe.dix and decomment the "guesser" section

@@ Line 1: / Line 1: @@
 Here is an example of how to lemmatise using [[apertium-swe]].
+First install:
-Install:
+* [[lttoolbox]]
-* Lttoolbox
+* [[apertium]]
-* Apertium
+* [[vislcg3]]
-* VISLCG
 <pre>