Difference between revisions of "Ideas for Google Summer of Code/Dictionary induction from parallel corpora"
Jump to navigation
Jump to search
Popcorndude (talk | contribs) (Created page with "== Coding Challenge == Write a script that reads two parallel corpora, applies the monolingual taggers and a word-aligner, and then prints a list of paired words.") |
Popcorndude (talk | contribs) |
||
(One intermediate revision by the same user not shown) | |||
Line 1: | Line 1: | ||
== Coding Challenge == |
== Coding Challenge == |
||
− | Write a script that reads two parallel corpora, applies the monolingual taggers and |
+ | Write a script that reads two parallel corpora, applies the appropriate monolingual taggers and some word-aligner ([https://github.com/robertostling/eflomal eflomal] is pretty straightforward if you don't know where to begin), and then prints a list of paired words. |
+ | |||
+ | $ cat eng.txt |
||
+ | The cat ate the fish. |
||
+ | $ cat spa.txt |
||
+ | El gato comió el pez. |
||
+ | $ alignment-script apertium-eng/ eng.txt apertium-spa/ spa.txt |
||
+ | the<det><def><mf><sp> - el<det><def><m><sg> |
||
+ | cat<n><sg> - gato<n><m><sg> |
||
+ | ... |
Latest revision as of 18:17, 21 March 2024
Coding Challenge[edit]
Write a script that reads two parallel corpora, applies the appropriate monolingual taggers and some word-aligner (eflomal is pretty straightforward if you don't know where to begin), and then prints a list of paired words.
$ cat eng.txt The cat ate the fish. $ cat spa.txt El gato comió el pez. $ alignment-script apertium-eng/ eng.txt apertium-spa/ spa.txt the<det><def><mf><sp> - el<det><def><m><sg> cat<n><sg> - gato<n><m><sg> ...