Conllu Parsing and Searching

Parse and Search through a conllu file

Searching is as follows:

Word-based search: the '<' character

If you want to find a specific word (e.g., you want to find the word "bread" in your ConLL-U file), you create a search with the < symbol followed by the word you want to search for.

For example, the search term '<ести might return:

'Token: 6, Form: ести, Lemma: есті, UPOSTAG: VERB, HEAD: 0, DEPREL: root, # sent_id = story.tagged.txt:44:776, Sentence:  Ол енді ол дыбысты анығырақ ести бастады .' 

The format of the result is the Token (where in the sentence the match appeared), the lemma, the upostag (part of speech), the HEAD, and the sentence_id.

The '{' character

If you would like to search with a tree(i.e you want to search for a word with a HEAD value or word):

You would start your search with a '{'

Then, between the words you are searching for a relation between add a '>'

For instance, if you wanted to see when 'have' did action to 'clue' (i.e. I have no clue') you would use this character

An example entry would be '{have>clue'

If you wanted, you could also be more specific or ambigious

When searching with attributes (i.e UPOSTAG), you could do this like:

'{upostag=verb, form=have>form=clue'

PLEASE NOTE THAT WHEN YOU SPECIFY EXTRA ATTRIBUTES YOU HAVE TO PUT 'Form=' ARGUMENT FOR THE WORD

If you wanted to specify nothing and look for words that do action to bread, you would use:

'{none=none>form=clue}'

PLEASE NOTE THAT YOU HAVE TO HAVE 'NONE=NONE' WHERE NOTHING IS SPECIFIED

You can also specify attributes instead of 'form=clue' such as 'upostag=noun'

Example Output:

Token: 2, Form: have, Lemma: have, UPOSTAG: VERB, HEAD: 0, DEPREL: root, # sent_id = 2, Sentence: I have no clue .

The ':' character

If you would like to search for a deprel or upostag and a feature in a word:

You would start your search with a ':' and encapsulate your search with '[]'

For instance if you wanted to search for a copula and past feature you would do

':[cop, past]'

This would find a copula with a past feature and have an output like:

'Token: 3, Form: болғаныма, Lemma: бол, UPOSTAG: AUX, HEAD: 2, DEPREL: cop, # sent_id = akorda-random.tagged.txt:158:2829, Sentence: Мен осында болғаныма қуаныштымын қуанышты мын .'

The ';' character

If you would like to search with a relationship(i.e nsubj relation to another node that has a noun POS)

You would start your search with a ';'

You would then type a deprel tag followed by a colon and then a part of speech

The second term(the one after the ';') can also be the lemma or the word id_name

You would use to search for a word with nsubj relationship with a noun:

';nsubj:noun'

Could Output:

'Token: 8, Form: жүзімдік, Lemma: жүзімдік, UPOSTAG: NOUN, HEAD: 6, DEPREL: conj, # sent_id = Шымкент.tagged.txt:8:216, Sentence: Тау етегінде өзен бойындағы алқаптарда егіншілік пен жүзімдік ал көгалды таулы жайылымдарда - мал шаруашылығы дамыған .'

Example Of How To Use This Program

python conlluparse.py "text.conllu" ':[cop, past]'

python conlluparse.py "text.conllu" ';nsubj:noun'

python conlluparse.py "text.conllu" '{none=none>form=bread}'

python conlluparse.py "text.conllu" '<bread'