Dialectal or standard variation - Revision history

Unhammer: /* Enabling preferences in a language pair */

2022-11-01T10:33:29Z

Enabling preferences in a language pair

Unhammer: /* Enabling preferences in a language pair */

2022-11-01T10:33:05Z

Enabling preferences in a language pair

Unhammer: /* Enabling preferences in a language pair */

2022-11-01T10:32:07Z

Enabling preferences in a language pair

Unhammer: /* Describing preferences to the user */

2022-11-01T10:29:26Z

Describing preferences to the user

Unhammer: /* Inspecting/debugging bidix preferences */

2022-11-01T10:09:37Z

Inspecting/debugging bidix preferences

Unhammer: /* Describing preferences to the user */

2022-11-01T10:07:50Z

Describing preferences to the user

Unhammer: /* Overlapping variants */

2022-11-01T09:59:21Z

Overlapping variants

Unhammer: /* Overlapping variants */

2022-11-01T09:58:10Z

Overlapping variants

Unhammer: /* Overlapping variants */

2022-11-01T09:57:43Z

Overlapping variants

Unhammer: /* Bidix preferences */

2022-08-16T16:31:39Z

Bidix preferences

@@ Line 324: / Line 324: @@
 The Makefile.am also needs some changes, see
-* https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f pair (ignore the <nowiki><code>$(PREFIX2)_e</code></nowiki> thing, that's just for backward compatibility with an old mode)
+* https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f pair (ignore the <code><nowiki>$(PREFIX2)_e</nowiki></code> thing, that's just for backward compatibility with an old mode)
 * https://github.com/apertium/apertium-nno/compare/77d3cf3f90e234ac0e45b17e231399ab364e2f46%5E..0b783a7a40f51bc02e55f30d98261fb5461267c2 generator

@@ Line 324: / Line 324: @@
 The Makefile.am also needs some changes, see
-* https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f pair
+* https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f pair (ignore the <nowiki><code>$(PREFIX2)_e</code></nowiki> thing, that's just for backward compatibility with an old mode)
 * https://github.com/apertium/apertium-nno/compare/77d3cf3f90e234ac0e45b17e231399ab364e2f46%5E..0b783a7a40f51bc02e55f30d98261fb5461267c2 generator

@@ Line 315: / Line 315: @@
        </program>
 </pre>
-The Makefile.am also needs some changes, see
-https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f
-(or just grep -i "prefs" apertium-nno-nob/Makefile.am) for how to do it in the pair.
 You also need files
@@ Line 326: / Line 322: @@
 * apertium-oci-fra/fra-oci.preferences.xml
 * apertium-oci-fra/apertium-oci-fra.fra-oci.biprefs.rlx
+The Makefile.am also needs some changes, see
+* https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f pair
+* https://github.com/apertium/apertium-nno/compare/77d3cf3f90e234ac0e45b17e231399ab364e2f46%5E..0b783a7a40f51bc02e55f30d98261fb5461267c2 generator
+(or grep -i "prefs" apertium-{nno,nno-nob}/Makefile.am)
 === Describing preferences to the user ===

@@ Line 285: / Line 285: @@
 </pre>
 (The tags are still visible in output because cg-proc is running in trace mode.)
+=== Enabling preferences in a language pair ===
+To start using preferences in a regular language pair that wasn't using them before, you first of all need to add the CG's that read the variables to modes.xml and change the generator to use bilingual mode, say we're adding it to the fra-oci mode:
+<pre>
+@@ -21,6 +21,9 @@
+       <program name="lt-proc -b">
+         <file name="fra-oci.autobil.bin"/>
+       </program>
++      <program name="cg-proc" debug-suff="biprefs">
++        <file name="fra-oci.biprefs.rlx.bin"/>
++      </program>
+       <program name="lrx-proc -m">
+         <file name="fra-oci.autolex.bin"/>
+       </program>
+@@ -60,9 +63,12 @@
+         <file name="fra-oci.autosep2.bin"/>
+       </program>
+       <program name="apertium-posttransfer" debug-suff="posttransfer"/>
+-      <program name="lt-proc $1">
++      <program name="lt-proc $1 -b" debug-suff="dgen">
+         <file name="fra-oci.autogen.bin"/>
+       </program>
++      <program name="cg-proc -1 -n -g" debug-suff="genprefs">
++        <file name="fra-oci.genprefs.rlx.bin"/>
++      </program>
+       <program name="lt-proc -p">
+         <file name="fra-oci.autopgen.bin"/>
+       </program>
+</pre>
+The Makefile.am also needs some changes, see
+https://github.com/apertium/apertium-nno-nob/compare/1b49a641279c8daec06f52c40875bd38fadaa535..178d28289e1b1944139c04211f3723eda340073f
+(or just grep -i "prefs" apertium-nno-nob/Makefile.am) for how to do it in the pair.
+You also need files
+* apertium-oci/oci.preferences.xml
+* apertium-oci/apertium-oci.oci.genprefs.rlx
+* apertium-oci-fra/fra-oci.preferences.xml
+* apertium-oci-fra/apertium-oci-fra.fra-oci.biprefs.rlx
 === Describing preferences to the user ===

@@ Line 245: / Line 245: @@
 === Inspecting/debugging bidix preferences ===
+'veps_kvefs' is a bidix-defined preference, output from bidix will be ambiguous
 <pre>
-$ echo veps | ad -d . nob-nno_e-biltrans
-^veps<n><m><sg><ind><aa><@laus-np>/veps<n><m><sg><ind><aa><@laus-np>/kvefs<n><m><sg><ind><aa><@laus-np>$^.<sent><clb><aa>/.<sent><clb><aa>$
 $ echo veps | apertium -f none -d . nob-nno_e-biltrans
 ^veps<n><m><sg><ind><aa><@subj>/veps<n><m><sg><ind><aa><@subj>/kvefs<n><m><sg><ind><aa><@subj>$
+</pre>
+Without setting the variable (or with it set to empty string), the biprefs CG picks veps (first one after slash):
+<pre>
 $ echo veps | apertium -f none -d . nob-nno_e-biprefs
 ^veps<n><m><sg><ind><aa><@subj>/veps<n><m><sg><ind><aa><@subj>/¬kvefs<n><m><sg><ind><aa><@subj><REMOVE:63:veps_veps>$
+</pre>
+With it set, the tl reading (first after slash) is kvefs:
+<pre>
 $ echo veps | AP_SETVAR='veps_kvefs' apertium -f none -d . nob-nno_e-biprefs
 ^veps<n><m><sg><ind><aa><@subj>/kvefs<n><m><sg><ind><aa><@subj><SELECT:62:veps_kvefs>/¬veps<n><m><sg><ind><aa><@subj><SELECT:62:veps_kvefs>$

@@ Line 243: / Line 243: @@
 (any other features will be REMOVE'd by the following file as long as no stream variables are set).
+=== Inspecting/debugging bidix preferences ===
+<pre>
+$ echo veps | ad -d . nob-nno_e-biltrans
+^veps<n><m><sg><ind><aa><@laus-np>/veps<n><m><sg><ind><aa><@laus-np>/kvefs<n><m><sg><ind><aa><@laus-np>$^.<sent><clb><aa>/.<sent><clb><aa>$
+$ echo veps | apertium -f none -d . nob-nno_e-biltrans
+^veps<n><m><sg><ind><aa><@subj>/veps<n><m><sg><ind><aa><@subj>/kvefs<n><m><sg><ind><aa><@subj>$
+$ echo veps | apertium -f none -d . nob-nno_e-biprefs
+^veps<n><m><sg><ind><aa><@subj>/veps<n><m><sg><ind><aa><@subj>/¬kvefs<n><m><sg><ind><aa><@subj><REMOVE:63:veps_veps>$
+$ echo veps | AP_SETVAR='veps_kvefs' apertium -f none -d . nob-nno_e-biprefs
+^veps<n><m><sg><ind><aa><@subj>/kvefs<n><m><sg><ind><aa><@subj><SELECT:62:veps_kvefs>/¬veps<n><m><sg><ind><aa><@subj><SELECT:62:veps_kvefs>$
+</pre>
+=== Inspecting/debugging generator preferences ===
+'infa_infe' and 'kj_k' are generator preferences, so the output from
+the generator will have these tags on the form side:
+<pre>
+$ echo 'søke' | apertium -f none -d . nob-nno-dgen
+^søke<vblex><inf>/søkja/søk<v:kj_k>a/søkje<v:infa_infe>/søk<v:kj_k>e<v:infa_infe>$
+</pre>
+With variable unset, the genprefs CG picks 'søkja':
+<pre>
+$ echo 'søke' | AP_SETVAR='' apertium -d . nob-nno-genprefs
+søkja/¬søka<v:kj_k><REMOVE:28>/¬søkje<v:infa_infe><REMOVE:20>/¬søke<v:kj_k><v:infa_infe><REMOVE:20>
+</pre>
+With both prefs set, the genprefs CG picks 'søke':
+<pre>
+$ echo 'søke' | AP_SETVAR='infa_infe,kj_k' apertium -d . nob-nno-genprefs
+søke<v:kj_k><v:infa_infe><SELECT:19><SELECT:27>/¬søkja<SELECT:19>/¬søka<v:kj_k><SELECT:19>/¬søkje<v:infa_infe><SELECT:19><SELECT:27>
+</pre>
+(The tags are still visible in output because cg-proc is running in trace mode.)
 === Describing preferences to the user ===

@@ Line 128: / Line 128: @@
 a comma-separated list of preferences:
+<pre>
-    $ export AP_SETVAR='' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
+$ export AP_SETVAR='' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
-    Me kan søkja forskjellar
+Me kan søkja forskjellar
-    $ export AP_SETVAR='me_vi' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
+$ export AP_SETVAR='me_vi' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
-    Vi kan søkja forskjellar
+Vi kan søkja forskjellar
-    $ export AP_SETVAR='me_vi,kj_k' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
+$ export AP_SETVAR='me_vi,kj_k' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
-    Vi kan søka forskjellar
+Vi kan søka forskjellar
-    $ export AP_SETVAR='me_vi,kj_k,forskjell_skilnad' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
+$ export AP_SETVAR='me_vi,kj_k,forskjell_skilnad' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
-    Vi kan søka skilnader
+Vi kan søka skilnader
-    $ export AP_SETVAR='me_vi,kj_k,forskjell_skilnad,infa_infe' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
+$ export AP_SETVAR='me_vi,kj_k,forskjell_skilnad,infa_infe' ; echo 'Vi kan søke forskjeller' | apertium -d . nob-nno
-    Vi kan søke skilnader
+Vi kan søke skilnader
+</pre>
 === Bidix preferences ===

@@ Line 109: / Line 109: @@
 * me kan søkja skilnader
-<small>(actually "skilnadar" is also a possibility …)</small>
+<small>(actually "skilnadAr" is also a possibility …)</small>
 There may be some correlation of people writing "me" and "søkja" vs

← Older revision		Revision as of 16:31, 16 August 2022
Line 158:		Line 158:


	See [https://github.com/apertium/apertium-nno-nob/commit/f44804648513e49be54476b9b75a173066f0a589 nno-nob commit f448046] (you can ignore the dev/ changes) for an example of going from bidix LR's to variants. Here the word "motsetnad" used to be marked LR in bidix and never chosen when translating right-to-left. After the change, ~~it's~~ ~~ambiguous~~ in ~~bidix~~, and the CG rule picks it based on stream ~~variables~~.		See [https://github.com/apertium/apertium-nno-nob/commit/f44804648513e49be54476b9b75a173066f0a589 nno-nob commit f448046] (you can ignore the dev/ changes) for an example of going from bidix LR's to variants. Here the word "motsetnad" used to be marked LR in bidix and never chosen when translating right-to-left. After the change, bidix outputs both "motsetnad" and "motsetning", and the CG rule picks one of them based on what stream variable is set.

	=== Generator preferences ===		=== Generator preferences ===