Ideas for Google Summer of Code/Discontiguous multiwords - Revision history

Unhammer at 12:33, 4 March 2016

2016-03-04T12:33:38Z

Unhammer: /* Tasks */

2015-02-18T13:53:04Z

Tasks

Unhammer: /* Tasks */

2015-02-18T13:52:22Z

Tasks

Unhammer at 13:51, 18 February 2015

2015-02-18T13:51:12Z

Unhammer at 13:32, 18 February 2015

2015-02-18T13:32:00Z

Francis Tyers at 21:40, 25 March 2013

2013-03-25T21:40:40Z

Francis Tyers: /* See also */

2013-03-21T13:38:23Z

Francis Tyers: /* Coding challenge */

2013-03-14T12:38:56Z

Coding challenge

Francis Tyers at 12:37, 14 March 2013

2013-03-14T12:37:29Z

Francis Tyers at 12:19, 14 March 2013

2013-03-14T12:19:57Z

@@ Line 17: / Line 17: @@
 ** Separable/phrasal verbs
 * Create a new FST-based module for recognising and reordering discontiguous multiword expressions
+** Multiwords would be specified in a handwritten dictionary given as input to the module
 ** This module would go between apertium-pretransfer and "lt-proc -b" (or between apertium-pretransfer and apertium-transfer for older pairs that don't use "lt-proc -b")
 ** It would reorder the words before bilingual dictionary lookup, so that e.g. "bryte<vblex> bru<n> saman<adv>" turns into "bryte# saman<vblex> bru<n>"

@@ Line 18: / Line 18: @@
 * Create a new FST-based module for recognising and reordering discontiguous multiword expressions
 ** This module would go between apertium-pretransfer and "lt-proc -b" (or between apertium-pretransfer and apertium-transfer for older pairs that don't use "lt-proc -b")
-** It would reorder the words, so that e.g. "bryte<vblex> bru<n> saman<adv>" turns into "bryte# saman<vblex> bru<n>"
+** It would reorder the words before bilingual dictionary lookup, so that e.g. "bryte<vblex> bru<n> saman<adv>" turns into "bryte# saman<vblex> bru<n>"
 * Include support for discontiguous multiwords in an existing language pair.
 ** English-Catalan, English-Spanish, Icelandic-English, Dutch-Afrikaans, ...

@@ Line 18: / Line 18: @@
 * Create a new FST-based module for recognising and reordering discontiguous multiword expressions
 ** This module would go between apertium-pretransfer and "lt-proc -b" (or between apertium-pretransfer and apertium-transfer for older pairs that don't use "lt-proc -b")
+** It would reorder the words, so that e.g. "bryte<vblex> bru<n> saman<adv>" turns into "bryte# saman<vblex> bru<n>"
 * Include support for discontiguous multiwords in an existing language pair.
 ** English-Catalan, English-Spanish, Icelandic-English, Dutch-Afrikaans, ...

@@ Line 17: / Line 17: @@
 ** Separable/phrasal verbs
 * Create a new FST-based module for recognising and reordering discontiguous multiword expressions
+** This module would go between apertium-pretransfer and "lt-proc -b" (or between apertium-pretransfer and apertium-transfer for older pairs that don't use "lt-proc -b")
 * Include support for discontiguous multiwords in an existing language pair.
 ** English-Catalan, English-Spanish, Icelandic-English, Dutch-Afrikaans, ...

@@ Line 3: / Line 3: @@
 In many languages, such as English, Norwegian and Icelandic, there are discontiguous multiwords, e.g. phrasal verbs, that we cannot easily support. For example 'liggja ekki fyrir' in Icelandic should be translated in English as 'to be not clear', but we cannot have 'liggja fyrir' as a traditional multiword because of the extra 'adverb', or it could even be a whole NP.
+Another example: in Norwegian, "bryta seg inn" means "break in", while "bryta saman" means "collapse". Both these can have an NP between the main verb and the other parts. So:
+* Tjuvane braut seg inn i huset = The thieves broke into the house
+* Natt til i går  braut  tjuvane  seg inn  i huset = The night before yesterday, the thieves broke into the house
+* Brua braut saman = The bridge collapsed
+* Natt til i går  braut  brua     saman            = The night before yesterday, the bridge collapsed
+When the whole phrasal verb is together, we can easily translate it as one part, so we get the right translation (broke into vs collapsed); but when they're separated by an NP, we don't have a general method to translate them as one unit, so we might end up outputting something bad like "Night to yesterday broke the bridge together"
 ==Tasks==

@@ Line 41: / Line 41: @@
 ==Frequently asked questions==
-* none yet, ''ask us something!'' :)
+* none yet, ''[[contact|ask us]] something!'' :)
 ==See also==

@@ Line 20: / Line 20: @@
 <pre>
- To keep the meat juicy , usually a cook would *take the seared meat out* before vegetables are added , and *put the meat back* right before vegetables are done .
+ To keep the meat juicy , usually a cook would *take the seared meat out* before vegetables are added , and *put the meat back*
+ right before vegetables are done .
- Contact wearers must usually *take their contact lenses out* every night or every few days , depending on the brand and style of the contact .
- He saved the building by pointing out that the vast amount of rubble from the demolished building would so clog the streets it would >take years to clear away< .
+ Contact wearers must usually *take their contact lenses out* every night or every few days , depending on the brand and style of
+ the contact .
+ He saved the building by pointing out that the vast amount of rubble from the demolished building would so clog the streets it
+ would >take years to clear away< .
  It needed canals only to *take goods in and out* from seagoing ships , where such rivers were unavailable . .
- When she passed out , Rhun tried to *take her wedding ring off* to prove her unfaithfulness
+ When she passed out , Rhun tried to *take her wedding ring off* to prove her unfaithfulness .
- The tanks make up such a small percentage of the total booster weight that the weight penalty of lifting them to orbit is less than the technical and weight penalty required to *throw half of them away* mid-flight .
+ The tanks make up such a small percentage of the total booster weight that the weight penalty of lifting them to orbit is less
+ than the technical and weight penalty required to *throw half of them away* mid-flight .
 </pre>

@@ Line 4: / Line 4: @@
 In many languages, such as English, Norwegian and Icelandic, there are discontiguous multiwords, e.g. phrasal verbs, that we cannot easily support. For example 'liggja ekki fyrir' in Icelandic should be translated in English as 'to be not clear', but we cannot have 'liggja fyrir' as a traditional multiword because of the extra 'adverb', or it could even be a whole NP.
-==Objectives==
+==Tasks==
 * Create a typology of different types of discontiguous multiword expressions in Germanic, Celtic, Romance, Turkic, Uralic languages
@@ Line 11: / Line 11: @@
 * Include support for discontiguous multiwords in an existing language pair.
 ** English-Catalan, English-Spanish, Icelandic-English, Dutch-Afrikaans, ...
-==First steps==
-<pre>
-<spectei> so, for that i would recommend you install the is-en language pair
-<spectei> and the multiword-reorder module
-<spectei> https://apertium.svn.sourceforge.net/svnroot/apertium/branches/gsoc2010/skh/multiword-reorder
-<spectei> and start "playing"
-<spectei> some of the features work
-<spectei> but it is poorly documented
-<spectei> and isn't yet included in any language pair
-<spectei> the link for is-en is: https://apertium.svn.sourceforge.net/svnroot/apertium/trunk/apertium-is-en
-<spectei> http://wiki.apertium.org/wiki/Minimal_installation_from_SVN
-</pre>
 ==Coding challenge==
+* Install a language pair where one of the languages has discontiguous multiwords, e.g. English-Catalan, English-Spanish, Icelandic-English, Dutch-Afrikaans.
 * Write a stream processor (see [[Apertium stream format]]) for the output of <code>apertium-tagger -p -g</code> that parses character by character, respecting [[superblanks]].