Difference between revisions of "RFERL corpora"
Jump to navigation
Jump to search
Firespeaker (talk | contribs) |
Firespeaker (talk | contribs) |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| − | Radio Free Europe / Radio Liberty runs news services in a number of Central Asian languages. The information is essentially free for public use with attribution. {{comment|link to usage info}} |
+ | Radio Free Europe / Radio Liberty runs news services in a number of Central Asian languages. The information is essentially free for public use with attribution. {{comment|need link to usage info}} |
| − | + | We discovered [[Turkish and Kyrgyz/Making a corpus from azattyk|how a corpus could be built from their website]], and have instructions for [[writing a scraper]] in the framework we developed for it. Currently we have corpora for Kazakh and Kyrgyz, covering only a couple years' worth of articles. |
|
== Kyrgyz == |
== Kyrgyz == |
||
| Line 9: | Line 9: | ||
=== 2009 === |
=== 2009 === |
||
* Number of stems: {{:RFERL corpus/ky/2009/stems}} |
* Number of stems: {{:RFERL corpus/ky/2009/stems}} |
||
| − | * Coverage: {{:Kymorph/coverage/rferl2009}} |
+ | * Coverage: ~{{:Kymorph/coverage/rferl2009}}% |
=== 2010 === |
=== 2010 === |
||
* Number of stems: {{:RFERL corpus/ky/2010/stems}} |
* Number of stems: {{:RFERL corpus/ky/2010/stems}} |
||
| − | * Coverage: {{:Kymorph/coverage/rferl2010}} |
+ | * Coverage: ~{{:Kymorph/coverage/rferl2010}}% |
== Kazakh == |
== Kazakh == |
||
| Line 20: | Line 20: | ||
=== 2009 === |
=== 2009 === |
||
* Number of stems: {{:RFERL corpus/kk/2009/stems}} |
* Number of stems: {{:RFERL corpus/kk/2009/stems}} |
||
| − | * Coverage: {{:Kazmorph/coverage/rferl2009}} |
+ | * Coverage: ~{{:Kazmorph/coverage/rferl2009}}% |
=== 2010 === |
=== 2010 === |
||
* Number of stems: {{:RFERL corpus/kk/2010/stems}} |
* Number of stems: {{:RFERL corpus/kk/2010/stems}} |
||
| − | * Coverage: {{:Kazmorph/coverage/rferl2010}} |
+ | * Coverage: ~{{:Kazmorph/coverage/rferl2010}}% |
Latest revision as of 18:41, 5 December 2013
Radio Free Europe / Radio Liberty runs news services in a number of Central Asian languages. The information is essentially free for public use with attribution.
need link to usage info
We discovered how a corpus could be built from their website, and have instructions for writing a scraper in the framework we developed for it. Currently we have corpora for Kazakh and Kyrgyz, covering only a couple years' worth of articles.
Kyrgyz[edit]
- Site: azattyk.org
- Coverage with: kymorph
2009[edit]
- Number of stems: 4.1M
- Coverage: ~87.4%
2010[edit]
- Number of stems: 3.4M
- Coverage: ~88%
Kazakh[edit]
- Site: azattyq.org
2009[edit]
- Number of stems: RFERL corpus/kk/2009/stems
- Coverage: ~Kazmorph/coverage/rferl2009%
2010[edit]
- Number of stems: 3.2M
- Coverage: ~85.4%
