RFERL corpora

From Apertium

Jump to navigation Jump to search

Radio Free Europe / Radio Liberty runs news services in a number of Central Asian languages. The information is essentially free for public use with attribution.

need link to usage info

We discovered how a corpus could be built from their website, and have instructions for writing a scraper in the framework we developed for it. Currently we have corpora for Kazakh and Kyrgyz, covering only a couple years' worth of articles.

Contents

1 Kyrgyz
- 1.1 2009
- 1.2 2010
2 Kazakh
- 2.1 2009
- 2.2 2010

Kyrgyz

Site: azattyk.org
Coverage with: kymorph

2009

Number of stems: 4.1M
Coverage: ~87.4%

2010

Number of stems: 3.4M
Coverage: ~88%

Kazakh

Site: azattyq.org

2009

Number of stems: RFERL corpus/kk/2009/stems
Coverage: ~Kazmorph/coverage/rferl2009%

2010

Number of stems: 3.2M
Coverage: ~85.4%

Retrieved from "https://wiki.apertium.org/w/index.php?title=RFERL_corpora&oldid=45430"