User:Xavivars/Overlapping language variants

Problem

Language variants are a great feature of Apertium. It allows you to create slightly different language pairs, where the core of the translations are the same.

However, the way variants are implemented is not properly suited for overlapping variants, when we have more than two variants for the same language that are not completely disjoint.

Let's take Catalan as an example:

• Currently, we have the base Catalan translation (cat), plus a Valencian variant (cat_valencia) based on the Universities language model.
• There used to exist an "economic focused" variant (cat_eco).
• Work is being done by Joan Moratinos to add suppor for a balearic variant (cat_balear, temptative name).

Let's imagine that we want to add another Valencian variant, based on the Generalitat (Valencian Government) or the AVL (Valencian Language Accademy), (cat_gva or cat_avl are the names I'll use here to support the example).

Let's also define a set of "language features", and are not overlapping:

• Verbs
  • CAT verb terminations (penso)
  • VAL verb terminations (pense)
  • BAL verb terminations (pens)
• Lexical choice
  • CAT lexical (sortir)
  • VAL lexical (eixir)
• Accents
  • CAT accents (interès)
  • VAL accents (interés)
• Demonstratives
  • Weak (aquest)
  • Strong (este)
• Possessives
  • U (meua, teua)
  • V (meva, teva)
• Economics lexic
  • Generic
  • Economics focused

The problem comes on how the different variants use each of the language features. As an example, the following chart shows only two of the features: verbs and accents.

For this example, if we just keep the current variants approach, we would need four variants to be present in the dictionaries. All 4 variants would need to define their own version for each "feature", (even if some of them are identical):

• cat_balear would need to have all the same verb entries than cat, and same thing would happen for cat_valencia and cat_gva.
• In case of accents, cat, cat_balear and cat_valencia, as they share the same accents, would create the same entries three times in the dictionary, while another different entry would be added to support cat_gva