Northern Sámi and Norwegian/smemorf

From Apertium
Jump to navigation Jump to search

apertium-sme-nob TODOs for the sme morphological analyser from Giellatekno.

Misc

  • HFST tokenisation
    • Also, split up lexicon into standard and inconditional (punctuation) for hfst-proc
  • find all Foc/foo tags and put them in dev/xfst2apertium.relabel
  • regex for acronyms like "GsoC:as" (tokenisation dependent...)
  • Proper casing support in the sme lexicon. (Mánát vs. mánát)
    • In the xerox software, this is done by a separate fst m (->) M || .#. _ ;

Compounding

Ensure compounding is only tried if there is no other solution. Use a weighted transducer, and give the compound border (ie the dynamic compounding border, the R lexicon) a non-zero weight.

Multiwords

Add simple multiwords and fixed expressions to the analyser.

MWE's won't be noticed until we get proper HFST tokenisation, eg. "ovdal go" (før) is already in the analyser.

  • lea go => ^leat<V><IV><Ind><Prs><Sg3><Qst> (just like "leago")
  • dasa lassin => i tillegg (til det)

(Some of these MWE's might be very Apertium-specific, but in that case we just keep our own file and append the entries with update-lexc.sh.)

Also, oktavuohta.N.Sg.Loc turns into an mwe preposition in nob:

  • oktavuođas => i forbindelse med

it'd be a lot simpler for transfer to just analyse such a fixed expression as oktavuođas.Po in the first place.