Difference between revisions of "Corpora"
Jump to navigation
Jump to search
(Category:Documentation in English) |
|||
| Line 8: | Line 8: | ||
::Use this if you want to do English--<something> (funny alignments for non-English pairs) |
::Use this if you want to do English--<something> (funny alignments for non-English pairs) |
||
* JRC-Acquis — http://langtech.jrc.it/JRC-Acquis.html — EU22 languages |
* JRC-Acquis — http://langtech.jrc.it/JRC-Acquis.html — EU22 languages |
||
::Use this if you want to do <anything>--<anything> |
::Use this if you want to do <anything>--<anything> and there is ''nothing better available''. |
||
* Southeast European Times — http://xixona.dlsi.ua.es/~fran/setimes/ — English,Turkish,Bulgarian,Macedonian,Serbo-Croatian,Albanian,Greek,Romanian — 9,000 approx. paragraph aligned, 90,000—120,000 words. |
* Southeast European Times — http://xixona.dlsi.ua.es/~fran/setimes/ — English,Turkish,Bulgarian,Macedonian,Serbo-Croatian,Albanian,Greek,Romanian — 9,000 approx. paragraph aligned, 90,000—120,000 words. |
||
* South African Government Services — http://xixona.dlsi.ua.es/~fran/services-gov-za-en_ZA-af_ZA.txt — English—Afrikaans — 2,500 approx. sentence aligned, 49,375 words. |
* South African Government Services — http://xixona.dlsi.ua.es/~fran/services-gov-za-en_ZA-af_ZA.txt — English—Afrikaans — 2,500 approx. sentence aligned, 49,375 words. |
||
Revision as of 11:24, 30 November 2013
Lists of corpora under free licences (public domain, CC-BY-SA, GPL, etc.).
You might also want to use Wikipedia as a corpus, see Tagger_training#Creating_a_corpus or Building_dictionaries#Wikipedia_dumps and the cleanup script at Calculating_coverage.
Corpora
- EuroParl — http://www.statmt.org/europarl/ — EU12 languages up to 44 million words per language
- Use this if you want to do English--<something> (funny alignments for non-English pairs)
- JRC-Acquis — http://langtech.jrc.it/JRC-Acquis.html — EU22 languages
- Use this if you want to do <anything>--<anything> and there is nothing better available.
- Southeast European Times — http://xixona.dlsi.ua.es/~fran/setimes/ — English,Turkish,Bulgarian,Macedonian,Serbo-Croatian,Albanian,Greek,Romanian — 9,000 approx. paragraph aligned, 90,000—120,000 words.
- South African Government Services — http://xixona.dlsi.ua.es/~fran/services-gov-za-en_ZA-af_ZA.txt — English—Afrikaans — 2,500 approx. sentence aligned, 49,375 words.
- IJS-ELAN — http://nl.ijs.si/elan/ — English-Slovenian
- OPUS — http://urd.let.rug.nl/tiedeman/OPUS/index.php — Open Source multilingual corpora
- Open-Tran — http://www.open-tran.eu — single point of access to translations of open-source software in many languages (downloadable as SQLite databases)
- Tatoeba Project — http://tatoeba.org/ — Database of example sentences translated into several languages.
Corpus tools
- Corpus Catcher — http://translate.sourceforge.net/wiki/corpuscatcher/index - Bootstrap corpora from the web
- BootCaT — http://sslmit.unibo.it/~baroni/bootcat.html - Simple Utilities to Bootstrap Corpora and Terms from the Web
- Bitextor — http://sourceforge.net/projects/bitextor/ - Bootstrap bilingual corpora from the web
