Difference between revisions of "Ideas for Google Summer of Code/Accent and diacritic restoration"
Jump to navigation
Jump to search
| Line 12: | Line 12: | ||
* Install Apertium |
* Install Apertium |
||
| − | * Check out and compile [https://apertium.svn.sourceforge.net/svnroot/apertium/branches/gsoc2011/charlifter |
+ | * Check out and compile [https://apertium.svn.sourceforge.net/svnroot/apertium/branches/gsoc2011/charlifter charlifter from GSOC2011] |
* <s>Make it output properly encoded Unicode instead of hexadecimal characters.</s> |
* <s>Make it output properly encoded Unicode instead of hexadecimal characters.</s> |
||
* Make it respect [[superblanks]]. |
* Make it respect [[superblanks]]. |
||
Revision as of 13:30, 10 March 2013
Many languages use diacritics and accents in normal writing, and Apertium is designed to use these, however in some places, especially for example. instant messaging, irc, searching in the web etc. these are often not used or untyped. This causes problems as for the engine, traduccion is not the same as traducción. Create an optional module to restore diacritics and accents on input text, and integrate it into the Apertium pipeline.
Tasks
- Finish the port of Kevin Scannell's charlifter to C++, it should respect superblanks
- Allow rule-based replacements of character sequences.
- Train models for all languages in Apertium.
- ...
Coding challenge
- Install Apertium
- Check out and compile charlifter from GSOC2011
Make it output properly encoded Unicode instead of hexadecimal characters.- Make it respect superblanks.
