Difference between revisions of "Turkish and Kyrgyz/Kymorph article"

From Apertium
Jump to navigation Jump to search
(Undo revision 28838 by Firespeaker (Talk))
 
(9 intermediate revisions by the same user not shown)
Line 19: Line 19:
 
** Wikipedia
  
** Wikipedia
 
**# [http://paste.pocoo.org/show/2KXepqcTTiWDWLOFPRlR/ punktgen.py] ky.crp.txt ky.pickle
  
**# [http://paste.pocoo.org/show/2KXepqcTTiWDWLOFPRlR/ punktgen.py] ky.crp.txt ky.pickle
−
**# aq-wikicrp -x -t ky.pickle kywiki-20110923-pages-articles.xml kywp.xml
 +
**# aq-wikicrp -x -t ky.pickle [http://download.wikimedia.org/kywiki/20110923/kywiki-20110923-pages-articles.xml.bz2 kywiki-20110923-pages-articles.xml] kywp.xml
 
** [[Turkish and Kyrgyz/Making a corpus from azattyk|Azattyk]]
  
** [[Turkish and Kyrgyz/Making a corpus from azattyk|Azattyk]]
 
* concerns
  
* concerns
Line 31: Line 31:
 
|
  
|
 
! wikipedia
  
! wikipedia
−
! azattyk
 +
! azattyk 2010
  +
! all azattyk
  +
|-
  +
! num articles
  +
| 1531([http://ky.wikipedia.org/wiki/Special:Statistics ?], [http://dumps.wikimedia.org/kywiki/20110923/ ?])
  +
| 9803 (6627?)
  +
|
 
|-
  
|-
 
! num words
  
! num words
 
| 271005
  
| 271005
  +
| 3394686
 
|
  
|
 
|-
  
|-
 
! xml file size
  
! xml file size
−
| >3.8MB
 +
| 3.8MB
  +
| 49MB
 
|
  
|
 
|}
  
|}

Latest revision as of 16:50, 13 October 2011

Outline[edit]

General background[edit]

Similar articles[edit]

Morphotactica[edit]

  • Irregular negatives of many verb forms

Morphophonologia[edit]

  • /рн/ nouns

Corpora[edit]

  • Which corpora to use?
  • concerns
    • Wikipedia is messy; should we have an automated cleaning process or get stats as-is?
      • Use aq-wikicrp, this way it is reproducible .

Numbers[edit]

size of corpora
wikipedia azattyk 2010 all azattyk
num articles 1531(?, ?) 9803 (6627?)
num words 271005 3394686
xml file size 3.8MB 49MB
Retrieved from "https://wiki.apertium.org/w/index.php?title=Turkish_and_Kyrgyz/Kymorph_article&oldid=28839"