Pending tasks
- Write a TSX file to group together fine tags into coarse tags.
Tag a corpus with IceTagger and train the apertium-tagger- Post-edit automatically-generated bilingual dictionaries
- Try and convert some IceTagger constraint rules to work in constraint grammar
- Use IceParser to parse a corpus and extract the most frequent patterns in terms of chunks/phrases (lists of coarse POS tags) and phrase patterns (in terms of chunks/phrases).
- Merge analysed corpus (IceMorphy full-form list) with Apertium dictionary — will require matching partial information to paradigms... perhaps use extract ?
- In the Icelandic analyser (
apertium-is-en.is.dix):
- Fix verb paradigms... most are missing:
- Participle forms (declensions) and infinitives
- Active and middle voice distinction (see file
dev/is-tags.mapping.txt for tag mapping details)
- Verbs are missing the supine
- Check declensions for adjectives to see if any parts can be factored out (e.g. the weak/strong inflection)
Move 'sta' and 'vei' tags to the end of the declension.
- Write transfer rules — start with most frequent patterns (as found from the corpus)
Resources
Corpora
- Mediawiki l10n, KDE4, OpenSubtitles, etc. — from OPUS (~60k sentences)
- Parliamentary Acts (?? sentences)
Bilingual dictionaries
Example phrase
- Hver maður er borinn frjáls og jafn öðrum að virðingu og réttindum.
IceFormat
Hver foken maður nken er sfg3en
borinn sþgken frjáls lkensf
og c jafn aa öðrum fokfþ að c
virðingu nveþ og c réttindum nhfþ . .
{*SUBJ> [NP Hver foken maður nken NP] *SUBJ>}
[VPb er sfg3en VPb]
{*COMP< [VPp borinn sþgken VPp] *COMP<}
{*COMP< [APs [AP frjáls lkensf AP] [CP og c CP] [AP jafn lkensf AP] APs] *COMP<}
[NP öðrum fokfþ NP]
[SCP að c SCP]
[NPs [NP virðingu nveþ NP] [CP og c CP] [NP réttindum nhfþ NP] NPs]
Apertium
^Hver<prn><ind><m><sg><nom>$ ^maður<n><m><sg><nom><ind>$ ^vera<vbser><pri><p3><sg>$
^bera<vblex><pp><m><sg><nom>$ ^frjáls<adj><sta><pst><m><sg><nom>$
^og<cnjcoo>$ ^jafn<adj><sta><pst><m><sg><nom>$
^annar<prn><ind><m><pl><dat>$ ^að<pr>$
^virðing<n><f><sg><dat><def>$ ^og<cnjcoo>$ ^réttindi<n><nt><pl><dat><ind>$ ^.<sent>$
^prn_nom<SN><@SUBJ→>{^Hver<prn><ind><m><sg><nom>$ ^maður<n><m><sg><nom><ind>$}$
^verb<SV>{^vera<vbser><pri><p3><sg>$ ^bera<vblex><pp><m><sg><nom>$}$
^adj_cc_adj<SA>{^frjáls<adj><sta><pst><m><sg><nom>$ ^og<cnjcoo>$ ^jafn<adj><sta><pst><m><sg><nom>$}$
^nom<SN>{^annar<prn><ind><m><pl><dat>$}$
^að<Prep>{^að<pr>$}$
^nom_cc_nom{^virðing<n><f><sg><dat><def>$ ^og<cnjcoo>$ ^réttindi<n><nt><pl><dat><ind>$}$
See also
