Ideas for Google Summer of Code/Corpus-based lexicalised feature transfer
< Ideas for Google Summer of Code
Jump to navigation
Jump to search
Revision as of 16:06, 4 March 2012 by Francis Tyers (talk | contribs)
Make a module that sits somewhere in the Apertium pipeline (somewhere after the lexical selection and before morphological generation) that sets features (eg. tags) based on a model generated from a corpus. Sometimes we get really inadequate translations even though you'd never hear stuff like that. One of those things is when we output something as definite when it is never used as definite. One way of dealing with this is a lot of rules and lists in transfer, but those are hard to do. So, how about looking at a corpus for information about some features like definiteness, aspect, evidentiality, impersonal/reflexive pronoun use in Romance languages etc.
Tasks
Coding challenge
- Make a stream processor (see Apertium stream format) for the output of apertium-transfer (both default/chunk possibilities) that parses character by character.