RFERL corpora
Jump to navigation
Jump to search
Radio Free Europe / Radio Liberty runs news services in a number of Central Asian languages. The information is essentially free for public use with attribution.
need link to usage info
We discovered how a corpus could be built from their website, and have instructions for writing a scraper in the framework we developed for it. Currently we have corpora for Kazakh and Kyrgyz, covering only a couple years' worth of articles.
Kyrgyz[edit]
- Site: azattyk.org
- Coverage with: kymorph
2009[edit]
- Number of stems: 4.1M
- Coverage: ~87.4%
2010[edit]
- Number of stems: 3.4M
- Coverage: ~88%
Kazakh[edit]
- Site: azattyq.org
2009[edit]
- Number of stems: RFERL corpus/kk/2009/stems
- Coverage: ~Kazmorph/coverage/rferl2009%
2010[edit]
- Number of stems: 3.2M
- Coverage: ~85.4%
