Difference between revisions of "VM for transfer"
Jump to navigation
Jump to search
Darthxaher (talk | contribs) m (→Byte-code) |
(Link to French page) |
||
(125 intermediate revisions by 7 users not shown) | |||
Line 1: | Line 1: | ||
[[Machine virtuelle pour le transfert|En français]] |
|||
== Instruction Sets == |
|||
== Instruction Set == |
|||
{| class="wikitable" border="1" |
{| class="wikitable" border="1" |
||
! Mnemonic !! Opcode<br>''(in hex)'' !! Other operands !! Stack<br>[before]→[after] !! Description |
! Mnemonic !! Opcode<br>''(in hex)'' !! Other operands !! Stack<br>[before]→[after] (top, top<sub>-1</sub>, ...) !! Description |
||
|- |
|- |
||
| push || - || value || [empty] → value || Pushes a value |
| push || - || value || [empty] → value || Pushes a string or a variable value onto the stack. Strings go between quotes ("string") but variable's names not |
||
|- |
|- |
||
| |
| pushbl || - || N/A || [empty] → blank || Pushes a blank onto the stack |
||
|- |
|- |
||
| |
| pushsb || - || pos || [empty] → superblank || Pushes the superblank at 'pos' onto the stack |
||
|- |
|- |
||
| |
| append || - || N || value<sub>N</sub>, ..., value<sub>1</sub>, varName → [empty] || Pops 'N' elements and appends them to a variable or clip |
||
|- |
|||
| concat || - || N || value<sub>N</sub>, ..., value<sub>1</sub> → value<sub>1</sub>...value<sub>N</sub> || Pops 'N' elements and pushes them back concatenated |
|||
|- |
|||
| clip || - || N/A || part → value || Obtains the part in the only language there is (inter/post-chunk) and pushes the value onto the stack |
|||
|- |
|||
| clipsl || - || link-to || part, pos → value || Obtains the 'part' in source language in position 'pos' and pushes the 'value' onto the stack. An optional operand is used for clips with link-to tags, e.g. "clipsl <3>". |
|||
|- |
|||
| cliptl || - || link-to || part, pos → value || Obtains the 'part' in target language in position 'pos' and pushes the 'value' onto the stack. An optional operand is used for clips with link-to tags, e.g. "cliptl <3>". |
|||
|- |
|||
| storecl || - || N/A || value, part → [empty] || Stores 'value' in the only language there is (inter/post-chunk) |
|||
|- |
|||
| storesl || - || N/A || value, part, pos → [empty] || Stores 'value' as the 'part' of the source language in position 'pos' |
|||
|- |
|||
| storetl || - || N/A || value, part, pos → [empty] || Stores 'value' as the 'part' of the target language in position 'pos' |
|||
|- |
|||
| storev || - || N/A || value, varName → [empty] || Stores 'value' in the variable with name 'varName' |
|||
|- |
|||
| addtrie || - || address || N, pattern<sub>N</sub>, ..., pattern<sub>1</sub> → [empty] || Pops 'N' patterns and creates a trie entry pointing to 'address' |
|||
|- |
|||
| lu || - || N || value<sub>N</sub>, ..., value<sub>1</sub> → ^(lexical_unit)$ || Pops 'N' values from the stack, creates a lexical unit ^...$ with them and pushes the lu back onto the stack |
|||
|- |
|||
| mlu || - || N || lu<sub>N</sub>, ..., lu<sub>1</sub> → multiword || Pops 'N' lu from the stack, creates a multiword with them and pushes the multiword back onto the stack |
|||
|- |
|||
| lu-count || - || N/A || [empty] → number || Pushes the number of lexical units (words inside the chunk) in the rule onto the stack |
|||
|- |
|||
| chunk || - || N || elem<sub>N-2</sub>, ... , elem<sub>1</sub>, <tags>, name → ^name<tags>{elem<sub>1</sub>...elem<sub>N-2</sub>}$ || Pops 'N' amount of data from the stack, creates the chunk and pushes it back onto the stack |
|||
|- |
|||
| out || - || N || value<sub>N</sub>, ..., value<sub>1</sub> → [empty] || Pops 'N' values from the stack and outputs them |
|||
|- |
|||
| cmp || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Pops 'value<sub>1</sub>' and 'value<sub>2</sub>', compares them, if they are equal pushes a 1 (true), if they aren't pushes a 0 (false) |
|||
|- |
|||
| cmpi || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Pops 'value<sub>1</sub>' and 'value<sub>2</sub>', compares them (ignoring case for each string), if they are equal pushes a 1 (true), if they aren't pushes a 0 (false) |
|||
|- |
|||
| cmp-substr || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Tests if 'value<sub>1</sub>' contains the substring 'value<sub>2</sub>', result can be 1 (true) or 0 (false). |
|||
|- |
|||
| cmpi-substr || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Tests if 'value<sub>1</sub>' contains the substring 'value<sub>2</sub>' (ignoring case for each string), result can be 1 (true) or 0 (false). |
|||
|- |
|||
| not || - || N || value → result || Negates the value on top of the stack, 0 -> 1 or 1 -> 0 |
|||
|- |
|||
| and || - || N || value<sub>N</sub>, ..., value<sub>1</sub> → result || And operation of 'N' values, result can be 1 (true) or 0 (false) |
|||
|- |
|||
| or || - || N || value<sub>N</sub>, ..., value<sub>1</sub> → result || Or operation of 'N' values, result can be 1 (true) or 0 (false) |
|||
|- |
|||
| in || - || N/A || list, value → result || Performs a search of a 'value' in a 'list' |
|||
|- |
|||
| inig || - || N/A || list, value → result || Performs a search (ignoring case) of a 'value' in a 'list' |
|||
|- |
|||
| jmp || - || label || [empty] → [empty] || Jumps to the label, unconditionally |
|||
|- |
|||
| jz || - || label || top → [empty] || Jumps to the label if stack.top == 0 |
|||
|- |
|||
| jnz || - || label || top → [empty] || Jumps to the label if stack.top == 1 |
|||
|- |
|||
| call || - || label || N, arg<sub>N</sub>, ..., arg<sub>1</sub> → [empty] || Calls a macro with the arguments on the stack |
|||
|- |
|||
| ret || - || N/A || [empty] → [empty] || Returns from a macro, PC will be handled automatically by the VM. |
|||
|- |
|||
| nop || - || N/A || [empty] → [empty] || No operation |
|||
|- |
|||
| case-of || - || N/A || container → case || Gets the case from the container in the stack. The container would usually be the result of a clip instruction but can be any string. |
|||
|- |
|||
| get-case-from || - || N/A || pos → case || Gets the case from the lexical unit in position 'pos' |
|||
|- |
|||
| modify-case || - || N/A || case, container → modifiedContainer || Modifies the case of the 'container' to 'case' and leaves the modified container on the stack |
|||
|- |
|||
| begins-with || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Checks if 'value<sub>1</sub>' begins with 'value<sub>2</sub>' and pushes 1 (true) or 0 (false), 'value<sub>2</sub>' can be a list |
|||
|- |
|||
| begins-with-ig || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Checks if 'value<sub>1</sub>' begins with 'value<sub>2</sub>' (ignoring the case) and pushes 1 (true) or 0 (false), 'value<sub>2</sub>' can be a list |
|||
|- |
|||
| ends-with || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Checks if 'value<sub>1</sub>' ends with 'value<sub>2</sub>' and pushes 1 (true) or 0 (false), 'value<sub>2</sub>' can be a list |
|||
|- |
|||
| ends-with-ig || - || N/A || value<sub>2</sub>, value<sub>1</sub> → result || Checks if 'value<sub>1</sub>' ends with 'value<sub>2</sub>' (ignoring the case) and pushes 1 (true) or 0 (false), 'value<sub>2</sub>' can be a list |
|||
|} |
|} |
||
* Lists are represented as a concatenation of items separated by '|', e.g. uno|otro|poco|cuánto|menos|mucho|tanto|demasiado |
|||
== Notes == |
|||
* The case is represented as "aa" (all lowercase), "Aa" (first uppercase) and "AA", (all uppercase). |
|||
== Code generation == |
|||
* None of the macro and actions need to return anything (unlike conventional functions), so provision for returning a value (using stack) is unnecessary |
|||
=== Code sections === |
|||
== Sample Translation from XML to byte-code == |
|||
The code generated by the compiler is divided in several sections. In addition, the VM reads and stores the code in its own sections. |
|||
{| class="wikitable" border="1" |
|||
! Section !! Code !! VM's section !! Information |
|||
|- |
|||
| align=center | Header || <code>#<assembly> <br /> #<transfer default="chunk"></code> || align=center | ---- || This section establishes the type of code generated and the transfer stage. |
|||
|- |
|||
| align=center | Initialisation || <code>push "genere"<br /> push "<m>"<br /> storev <br /> ... <br /> jmp rules_section_start</code> || align=center | Code section || In this section we initialize the variables with their default value and execute other initialisation code. <br /> At the end we jmp to the section rules section, although rules will only execute when a pattern is matched,<br /> we need to process all the patterns which are in the rules section. |
|||
|- |
|||
| align=center | Macros || <code>macro_firstWord_start: <br /> ... <br /> macro_firstWord_end: <br />...</code> || align=center | Macros code section || This section contains all the macro's code delimited by labels.<br /> Each macro can be called with the 'call' instruction. |
|||
|- |
|||
| align=center | Patterns || <code>section_rules_start:<br /> patterns_start:<br /> push "all<predet><sp>"<br /> push "<n><pl>"<br /> push 2<br /> addtrie action_0_start<br /> ... <br />patterns_end:</code> || align=center | Preprocess code section || In this section all the patterns will be added to the system trie. <br />In this example you can see that two patterns are pushed, then the number of patterns is pushed and finally<br /> the addtrie instruction pops them and adds an entry in the trie to the rule 0. |
|||
|- |
|||
| align=center | Rules || <code>action_0_start:<br /> ...<br /> action_0_end:<br /> ...<br /> section_rules_end:</code> || align=center | Rules code section || Finally the rules section contains every rule delimited by its labels and all its code. |
|||
|} |
|||
*One line comments can be made by using the '#' symbol at the start of the line. |
|||
=== Code examples === |
|||
==== Macro example ==== |
|||
===== Transfer file (.t1x) ===== |
|||
<code> |
<code> |
||
<out> |
|||
<source lang="xml"> |
|||
<chunk name="det_det_nom_adj" case="caseFirstWord"> |
|||
<tags> |
|||
<transfer default="chunk"> |
|||
<tag><lit-tag v="SN"/></tag> |
|||
<tag><var n="tipus_det"/></tag> |
|||
<section-def-attrs> |
|||
<tag><var n="gen_chunk"/></tag> |
|||
<def-attr n="nbr"> |
|||
<attr-item tags="sg"/> |
|||
<attr-item tags="pl"/> |
|||
<attr-item tags="sp"/> |
|||
<attr-item tags="ND"/> |
|||
</def-attr> |
|||
<clip pos="1" side="tl" part="gen_sense_mf" link-to="3"/> |
|||
</section-def-attrs> |
|||
<clip pos="1" side="tl" part="gen_mf"/> |
|||
<clip pos="1" side="tl" part="nbr_sense_sp" link-to="4"/> |
|||
<section-def-vars> |
|||
<clip pos="1" side="tl" part="nbr_sp"/> |
|||
<def-var n="nombre" v="&lt;sg&gt;"/> |
|||
</lu> |
|||
<def-var n="genere" v="&lt;m&gt;"/> |
|||
<b/> |
|||
</section-def-vars> |
|||
<lu> |
|||
<lit v="el"/> |
|||
<section-def-macros> |
|||
<lit-tag v="det.def"/> |
|||
<def-macro n="nombre_nom" npar="1"> |
|||
<clip pos="1" side="tl" part="gen_sense_mf" link-to="3"/> |
|||
<let> |
|||
</ |
<var n="nombre"/> |
||
< |
<lit v=""/> |
||
</let> |
|||
<choose> |
|||
<clip pos="3" side="tl" part="lemh"/> |
|||
<when> |
|||
<test> |
|||
<clip pos="3" side="tl" part="gen_sense_mf" link-to="3"/> |
|||
<and> |
|||
<equal> |
|||
<clip pos="3" side="tl" part="nbr_sense_sp" link-to="4"/> |
|||
<clip pos=" |
<clip pos="1" side="sl" part="nbr"/> |
||
<lit-tag v="sg"/> |
|||
</ |
</equal> |
||
< |
<equal> |
||
< |
<clip pos="1" side="tl" part="nbr"/> |
||
< |
<lit-tag v="pl"/> |
||
</equal> |
|||
</and> |
|||
< |
</test> |
||
<let> |
|||
<clip pos="2" side="tl" part="gen_sense_mf" link-to="3"/> |
|||
<var n="nombre"/> |
|||
<lit-tag v="pl_slsg"/> |
|||
< |
</let> |
||
</when> |
|||
< |
<when> |
||
< |
<test> |
||
< |
<and> |
||
<equal> |
|||
<clip pos="1" side="sl" part="nbr"/> |
|||
<lit-tag v="pl"/> |
|||
</equal> |
|||
<equal> |
|||
<clip pos="1" side="tl" part="nbr"/> |
|||
<lit-tag v="sg"/> |
|||
</equal> |
|||
</and> |
|||
</test> |
|||
<let> |
|||
<var n="nombre"/> |
|||
<lit-tag v="sg_slpl"/> |
|||
</let> |
|||
</when> |
|||
<otherwise> |
|||
<let> |
|||
<var n="nombre"/> |
|||
<clip pos="1" side="tl" part="nbr"/> |
|||
</let> |
|||
</otherwise> |
|||
</choose> |
|||
</def-macro> |
|||
</section-def-macros> |
|||
</transfer> |
|||
</source> |
|||
</code> |
</code> |
||
=== |
===== Code generated ===== |
||
<source lang="bash"> |
|||
<code> |
|||
#<assembly> |
|||
push "det_det_nom_adj" |
|||
#<transfer default="chunk"> |
|||
pusht "SN" ; push tag: "SN" -> "<SN>", then push in the stack |
|||
#<def-var v="<sg>" n="nombre"> |
|||
pusht tipus_det ; if operand does not start/end with ", then it's a variable |
|||
push "nombre" |
|||
; first evaluate the variable, then push in the stack |
|||
push "<sg>" |
|||
pusht gen_chunk |
|||
storev |
|||
pusht nbr_chunk |
|||
#<def-var v="<m>" n="genere"> |
|||
concat 5 ; pop 5 items from stack, concat and push as one item |
|||
push "genere" |
|||
push "<m>" |
|||
; code for the first lexical unit |
|||
storev |
|||
push 1 |
|||
jmp section_rules_start |
|||
push "^\w+" ; lem |
|||
#<def-macro npar="1" n="nombre_nom"> |
|||
macro_nombre_nom_start: |
|||
#<var n="nombre"> |
|||
push "nombre" |
|||
#<lit v=""> |
|||
push "" |
|||
storev |
|||
#<clip part="nbr" pos="1" side="sl"> |
|||
push 1 |
|||
push "<sg>|<pl>|<sp>|<ND>" |
|||
clipsl |
|||
#<lit-tag v="sg"> |
|||
push "<sg>" |
|||
cmp |
|||
#<clip part="nbr" pos="1" side="tl"> |
|||
push 1 |
|||
push "<sg>|<pl>|<sp>|<ND>" |
|||
cliptl |
cliptl |
||
#<lit-tag v="pl"> |
|||
push 1 |
|||
push "<pl>" |
|||
push [regex] ; a_det |
|||
cmp |
|||
and 2 |
|||
jz when_0_end |
|||
#<var n="nombre"> |
|||
push "nombre" |
|||
#<lit-tag v="pl_slsg"> |
|||
push "<pl_slsg>" |
|||
storev |
|||
jmp choose_0_end |
|||
when_0_end: |
|||
#<clip part="nbr" pos="1" side="sl"> |
|||
push 1 |
|||
push "<sg>|<pl>|<sp>|<ND>" |
|||
clipsl |
|||
#<lit-tag v="pl"> |
|||
push "<pl>" |
|||
cmp |
|||
#<clip part="nbr" pos="1" side="tl"> |
|||
push 1 |
|||
push "<sg>|<pl>|<sp>|<ND>" |
|||
cliptl |
cliptl |
||
#<lit-tag v="sg"> |
|||
push "<3>" ; since link-to overrides everything else, we do not need any dedicated instruction |
|||
push "<sg>" |
|||
; for that |
|||
cmp |
|||
push 1 |
|||
and 2 |
|||
push [regex] ; gen_mf |
|||
jz when_1_end |
|||
#<var n="nombre"> |
|||
push "nombre" |
|||
#<lit-tag v="sg_slpl"> |
|||
push "<sg_slpl>" |
|||
storev |
|||
jmp choose_0_end |
|||
when_1_end: |
|||
#<otherwise> |
|||
#<var n="nombre"> |
|||
push "nombre" |
|||
#<clip part="nbr" pos="1" side="tl"> |
|||
push 1 |
|||
push "<sg>|<pl>|<sp>|<ND>" |
|||
cliptl |
cliptl |
||
storev |
|||
push "<4>" |
|||
choose_0_end: |
|||
push 1 |
|||
macro_nombre_nom_end: ret |
|||
push [regex] ; nbr_sp |
|||
#<section-rules> |
|||
cliptl |
|||
section_rules_start: |
|||
lu 6 ; pop 6 items, concat, create lexical unit ^...$ and push back in stack |
|||
section_rules_end: |
|||
</source> |
|||
pushbl ; push a blank |
|||
---- |
|||
push "el" |
|||
push "<det><def>" |
|||
==== Rule's patterns example ==== |
|||
push "<3>" |
|||
push "<pl>" |
|||
===== Transfer file (.t1x) ===== |
|||
lu 4 ; pop 4 items from the stack, create a lexical unit ^...$ and then |
|||
<source lang="xml"> |
|||
; push in the stack |
|||
<transfer default="chunk"> |
|||
</code> |
|||
<section-def-cats> |
|||
<def-cat n="all"> |
|||
<cat-item lemma="all" tags="predet.sp"/> |
|||
</def-cat> |
|||
<def-cat n="adj2"> |
|||
<cat-item tags="adj"/> |
|||
<cat-item tags="adj.*"/> |
|||
<cat-item tags="adj.sint"/> |
|||
<cat-item tags="adj.sint.*"/> |
|||
<cat-item tags="adj.comp"/> |
|||
<cat-item tags="adj.sup"/> |
|||
</def-cat> |
|||
<def-cat n="nomcomu"> |
|||
<cat-item tags="n.*"/> |
|||
</def-cat> |
|||
<def-cat n="nompropi"> |
|||
<cat-item tags="np.*"/> |
|||
</def-cat> |
|||
<def-cat n="nploc"> |
|||
<cat-item tags="np.loc.*"/> |
|||
</def-cat> |
|||
</section-def-cats> |
|||
<rule> |
|||
<pattern> |
|||
<pattern-item n="all"/> |
|||
<pattern-item n="adj2"/> |
|||
</pattern> |
|||
<action> |
|||
... |
|||
</action> |
|||
</rule> |
|||
<rule> |
|||
<pattern> |
|||
<pattern-item n="nomcomu"/> |
|||
<pattern-item n="nompropi"/> |
|||
<pattern-item n="nploc"/> |
|||
</pattern> |
|||
<action> |
|||
... |
|||
</action> |
|||
</rule> |
|||
</section-rules> |
|||
</transfer> |
|||
</source> |
|||
===== Code generated ===== |
|||
<source lang="bash"> |
|||
#<assembly> |
|||
#<transfer default="chunk"> |
|||
jmp section_rules_start |
|||
#<section-rules> |
|||
section_rules_start: |
|||
patterns_start: |
|||
push "all<predet><sp>" |
|||
push "<adj>|<adj><*>|<adj><sint>|<adj><sint><*>|<adj><comp>|<adj><sup>" |
|||
push 2 |
|||
addtrie action_0_start |
|||
push "<n><*>" |
|||
push "<np><*>" |
|||
push "<np><loc><*>" |
|||
push 3 |
|||
addtrie action_1_start |
|||
patterns_end: |
|||
action_0_start: |
|||
... |
|||
action_0_end: |
|||
action_1_start: |
|||
... |
|||
action_1_end: |
|||
section_rules_end: |
|||
</source> |
|||
---- |
|||
==Wishlist== |
|||
* Make the compile options like with lt-comp/cg-comp (e.g. you don't need -i/-o to say what the input/output files are), just <code>apertium-compiler [options] <infile> <outfile></code> |
|||
==External links== |
|||
* [https://github.com/ggm/vm-for-transfer-cpp Github: vm-for-transfer-cpp] |
|||
[[Category:Development]] |
|||
[[Category:Documentation in English]] |
|||
[[Category:Transfer]] |
Latest revision as of 13:58, 7 October 2014
Contents
Instruction Set[edit]
Mnemonic | Opcode (in hex) |
Other operands | Stack [before]→[after] (top, top-1, ...) |
Description |
---|---|---|---|---|
push | - | value | [empty] → value | Pushes a string or a variable value onto the stack. Strings go between quotes ("string") but variable's names not |
pushbl | - | N/A | [empty] → blank | Pushes a blank onto the stack |
pushsb | - | pos | [empty] → superblank | Pushes the superblank at 'pos' onto the stack |
append | - | N | valueN, ..., value1, varName → [empty] | Pops 'N' elements and appends them to a variable or clip |
concat | - | N | valueN, ..., value1 → value1...valueN | Pops 'N' elements and pushes them back concatenated |
clip | - | N/A | part → value | Obtains the part in the only language there is (inter/post-chunk) and pushes the value onto the stack |
clipsl | - | link-to | part, pos → value | Obtains the 'part' in source language in position 'pos' and pushes the 'value' onto the stack. An optional operand is used for clips with link-to tags, e.g. "clipsl <3>". |
cliptl | - | link-to | part, pos → value | Obtains the 'part' in target language in position 'pos' and pushes the 'value' onto the stack. An optional operand is used for clips with link-to tags, e.g. "cliptl <3>". |
storecl | - | N/A | value, part → [empty] | Stores 'value' in the only language there is (inter/post-chunk) |
storesl | - | N/A | value, part, pos → [empty] | Stores 'value' as the 'part' of the source language in position 'pos' |
storetl | - | N/A | value, part, pos → [empty] | Stores 'value' as the 'part' of the target language in position 'pos' |
storev | - | N/A | value, varName → [empty] | Stores 'value' in the variable with name 'varName' |
addtrie | - | address | N, patternN, ..., pattern1 → [empty] | Pops 'N' patterns and creates a trie entry pointing to 'address' |
lu | - | N | valueN, ..., value1 → ^(lexical_unit)$ | Pops 'N' values from the stack, creates a lexical unit ^...$ with them and pushes the lu back onto the stack |
mlu | - | N | luN, ..., lu1 → multiword | Pops 'N' lu from the stack, creates a multiword with them and pushes the multiword back onto the stack |
lu-count | - | N/A | [empty] → number | Pushes the number of lexical units (words inside the chunk) in the rule onto the stack |
chunk | - | N | elemN-2, ... , elem1, <tags>, name → ^name<tags>{elem1...elemN-2}$ | Pops 'N' amount of data from the stack, creates the chunk and pushes it back onto the stack |
out | - | N | valueN, ..., value1 → [empty] | Pops 'N' values from the stack and outputs them |
cmp | - | N/A | value2, value1 → result | Pops 'value1' and 'value2', compares them, if they are equal pushes a 1 (true), if they aren't pushes a 0 (false) |
cmpi | - | N/A | value2, value1 → result | Pops 'value1' and 'value2', compares them (ignoring case for each string), if they are equal pushes a 1 (true), if they aren't pushes a 0 (false) |
cmp-substr | - | N/A | value2, value1 → result | Tests if 'value1' contains the substring 'value2', result can be 1 (true) or 0 (false). |
cmpi-substr | - | N/A | value2, value1 → result | Tests if 'value1' contains the substring 'value2' (ignoring case for each string), result can be 1 (true) or 0 (false). |
not | - | N | value → result | Negates the value on top of the stack, 0 -> 1 or 1 -> 0 |
and | - | N | valueN, ..., value1 → result | And operation of 'N' values, result can be 1 (true) or 0 (false) |
or | - | N | valueN, ..., value1 → result | Or operation of 'N' values, result can be 1 (true) or 0 (false) |
in | - | N/A | list, value → result | Performs a search of a 'value' in a 'list' |
inig | - | N/A | list, value → result | Performs a search (ignoring case) of a 'value' in a 'list' |
jmp | - | label | [empty] → [empty] | Jumps to the label, unconditionally |
jz | - | label | top → [empty] | Jumps to the label if stack.top == 0 |
jnz | - | label | top → [empty] | Jumps to the label if stack.top == 1 |
call | - | label | N, argN, ..., arg1 → [empty] | Calls a macro with the arguments on the stack |
ret | - | N/A | [empty] → [empty] | Returns from a macro, PC will be handled automatically by the VM. |
nop | - | N/A | [empty] → [empty] | No operation |
case-of | - | N/A | container → case | Gets the case from the container in the stack. The container would usually be the result of a clip instruction but can be any string. |
get-case-from | - | N/A | pos → case | Gets the case from the lexical unit in position 'pos' |
modify-case | - | N/A | case, container → modifiedContainer | Modifies the case of the 'container' to 'case' and leaves the modified container on the stack |
begins-with | - | N/A | value2, value1 → result | Checks if 'value1' begins with 'value2' and pushes 1 (true) or 0 (false), 'value2' can be a list |
begins-with-ig | - | N/A | value2, value1 → result | Checks if 'value1' begins with 'value2' (ignoring the case) and pushes 1 (true) or 0 (false), 'value2' can be a list |
ends-with | - | N/A | value2, value1 → result | Checks if 'value1' ends with 'value2' and pushes 1 (true) or 0 (false), 'value2' can be a list |
ends-with-ig | - | N/A | value2, value1 → result | Checks if 'value1' ends with 'value2' (ignoring the case) and pushes 1 (true) or 0 (false), 'value2' can be a list |
- Lists are represented as a concatenation of items separated by '|', e.g. uno|otro|poco|cuánto|menos|mucho|tanto|demasiado
- The case is represented as "aa" (all lowercase), "Aa" (first uppercase) and "AA", (all uppercase).
Code generation[edit]
Code sections[edit]
The code generated by the compiler is divided in several sections. In addition, the VM reads and stores the code in its own sections.
Section | Code | VM's section | Information |
---|---|---|---|
Header | #<assembly> |
---- | This section establishes the type of code generated and the transfer stage. |
Initialisation | push "genere" |
Code section | In this section we initialize the variables with their default value and execute other initialisation code. At the end we jmp to the section rules section, although rules will only execute when a pattern is matched, we need to process all the patterns which are in the rules section. |
Macros | macro_firstWord_start: |
Macros code section | This section contains all the macro's code delimited by labels. Each macro can be called with the 'call' instruction. |
Patterns | section_rules_start: |
Preprocess code section | In this section all the patterns will be added to the system trie. In this example you can see that two patterns are pushed, then the number of patterns is pushed and finally the addtrie instruction pops them and adds an entry in the trie to the rule 0. |
Rules | action_0_start: |
Rules code section | Finally the rules section contains every rule delimited by its labels and all its code. |
- One line comments can be made by using the '#' symbol at the start of the line.
Code examples[edit]
Macro example[edit]
Transfer file (.t1x)[edit]
<transfer default="chunk">
<section-def-attrs>
<def-attr n="nbr">
<attr-item tags="sg"/>
<attr-item tags="pl"/>
<attr-item tags="sp"/>
<attr-item tags="ND"/>
</def-attr>
</section-def-attrs>
<section-def-vars>
<def-var n="nombre" v="&lt;sg&gt;"/>
<def-var n="genere" v="&lt;m&gt;"/>
</section-def-vars>
<section-def-macros>
<def-macro n="nombre_nom" npar="1">
<let>
<var n="nombre"/>
<lit v=""/>
</let>
<choose>
<when>
<test>
<and>
<equal>
<clip pos="1" side="sl" part="nbr"/>
<lit-tag v="sg"/>
</equal>
<equal>
<clip pos="1" side="tl" part="nbr"/>
<lit-tag v="pl"/>
</equal>
</and>
</test>
<let>
<var n="nombre"/>
<lit-tag v="pl_slsg"/>
</let>
</when>
<when>
<test>
<and>
<equal>
<clip pos="1" side="sl" part="nbr"/>
<lit-tag v="pl"/>
</equal>
<equal>
<clip pos="1" side="tl" part="nbr"/>
<lit-tag v="sg"/>
</equal>
</and>
</test>
<let>
<var n="nombre"/>
<lit-tag v="sg_slpl"/>
</let>
</when>
<otherwise>
<let>
<var n="nombre"/>
<clip pos="1" side="tl" part="nbr"/>
</let>
</otherwise>
</choose>
</def-macro>
</section-def-macros>
</transfer>
Code generated[edit]
#<assembly>
#<transfer default="chunk">
#<def-var v="<sg>" n="nombre">
push "nombre"
push "<sg>"
storev
#<def-var v="<m>" n="genere">
push "genere"
push "<m>"
storev
jmp section_rules_start
#<def-macro npar="1" n="nombre_nom">
macro_nombre_nom_start:
#<var n="nombre">
push "nombre"
#<lit v="">
push ""
storev
#<clip part="nbr" pos="1" side="sl">
push 1
push "<sg>|<pl>|<sp>|<ND>"
clipsl
#<lit-tag v="sg">
push "<sg>"
cmp
#<clip part="nbr" pos="1" side="tl">
push 1
push "<sg>|<pl>|<sp>|<ND>"
cliptl
#<lit-tag v="pl">
push "<pl>"
cmp
and 2
jz when_0_end
#<var n="nombre">
push "nombre"
#<lit-tag v="pl_slsg">
push "<pl_slsg>"
storev
jmp choose_0_end
when_0_end:
#<clip part="nbr" pos="1" side="sl">
push 1
push "<sg>|<pl>|<sp>|<ND>"
clipsl
#<lit-tag v="pl">
push "<pl>"
cmp
#<clip part="nbr" pos="1" side="tl">
push 1
push "<sg>|<pl>|<sp>|<ND>"
cliptl
#<lit-tag v="sg">
push "<sg>"
cmp
and 2
jz when_1_end
#<var n="nombre">
push "nombre"
#<lit-tag v="sg_slpl">
push "<sg_slpl>"
storev
jmp choose_0_end
when_1_end:
#<otherwise>
#<var n="nombre">
push "nombre"
#<clip part="nbr" pos="1" side="tl">
push 1
push "<sg>|<pl>|<sp>|<ND>"
cliptl
storev
choose_0_end:
macro_nombre_nom_end: ret
#<section-rules>
section_rules_start:
section_rules_end:
Rule's patterns example[edit]
Transfer file (.t1x)[edit]
<transfer default="chunk">
<section-def-cats>
<def-cat n="all">
<cat-item lemma="all" tags="predet.sp"/>
</def-cat>
<def-cat n="adj2">
<cat-item tags="adj"/>
<cat-item tags="adj.*"/>
<cat-item tags="adj.sint"/>
<cat-item tags="adj.sint.*"/>
<cat-item tags="adj.comp"/>
<cat-item tags="adj.sup"/>
</def-cat>
<def-cat n="nomcomu">
<cat-item tags="n.*"/>
</def-cat>
<def-cat n="nompropi">
<cat-item tags="np.*"/>
</def-cat>
<def-cat n="nploc">
<cat-item tags="np.loc.*"/>
</def-cat>
</section-def-cats>
<rule>
<pattern>
<pattern-item n="all"/>
<pattern-item n="adj2"/>
</pattern>
<action>
...
</action>
</rule>
<rule>
<pattern>
<pattern-item n="nomcomu"/>
<pattern-item n="nompropi"/>
<pattern-item n="nploc"/>
</pattern>
<action>
...
</action>
</rule>
</section-rules>
</transfer>
Code generated[edit]
#<assembly>
#<transfer default="chunk">
jmp section_rules_start
#<section-rules>
section_rules_start:
patterns_start:
push "all<predet><sp>"
push "<adj>|<adj><*>|<adj><sint>|<adj><sint><*>|<adj><comp>|<adj><sup>"
push 2
addtrie action_0_start
push "<n><*>"
push "<np><*>"
push "<np><loc><*>"
push 3
addtrie action_1_start
patterns_end:
action_0_start:
...
action_0_end:
action_1_start:
...
action_1_end:
section_rules_end:
Wishlist[edit]
- Make the compile options like with lt-comp/cg-comp (e.g. you don't need -i/-o to say what the input/output files are), just
apertium-compiler [options] <infile> <outfile>