Difference between revisions of "Ideas for Google Summer of Code/Dictionary induction from parallel corpora"

From Apertium
Jump to navigation Jump to search
(Created page with "== Coding Challenge == Write a script that reads two parallel corpora, applies the monolingual taggers and a word-aligner, and then prints a list of paired words.")
 
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
 
== Coding Challenge ==
 
== Coding Challenge ==
   
Write a script that reads two parallel corpora, applies the monolingual taggers and a word-aligner, and then prints a list of paired words.
+
Write a script that reads two parallel corpora, applies the appropriate monolingual taggers and some word-aligner ([https://github.com/robertostling/eflomal eflomal] is pretty straightforward if you don't know where to begin), and then prints a list of paired words.
  +
  +
$ cat eng.txt
  +
The cat ate the fish.
  +
$ cat spa.txt
  +
El gato comió el pez.
  +
$ alignment-script apertium-eng/ eng.txt apertium-spa/ spa.txt
  +
the<det><def><mf><sp> - el<det><def><m><sg>
  +
cat<n><sg> - gato<n><m><sg>
  +
...

Latest revision as of 18:17, 21 March 2024

Coding Challenge[edit]

Write a script that reads two parallel corpora, applies the appropriate monolingual taggers and some word-aligner (eflomal is pretty straightforward if you don't know where to begin), and then prints a list of paired words.

$ cat eng.txt
The cat ate the fish.
$ cat spa.txt
El gato comió el pez.
$ alignment-script apertium-eng/ eng.txt apertium-spa/ spa.txt
the<det><def><mf><sp> - el<det><def><m><sg>
cat<n><sg> - gato<n><m><sg>
...