Weighted transfer rules - Revision history

Deltamachine: /* Expertiment */

2018-04-17T14:43:27Z

Expertiment

Deltamachine at 14:15, 17 April 2018

2018-04-17T14:15:34Z

Deltamachine: Created page with "== Related links == Idea description [[Weighted_transfer_rules_at_GSoC_2016|Nikita Medyankin's project at GSoC 201..."

2018-04-13T11:57:34Z

Created page with "== Related links == Idea description [[Weighted_transfer_rules_at_GSoC_2016|Nikita Medyankin's project at GSoC 201..."

New page

== Related links ==
[[Ideas_for_Google_Summer_of_Code/Weighted_transfer_rules|Idea description]]

[[Weighted_transfer_rules_at_GSoC_2016|Nikita Medyankin's project at GSoC 2016]]

https://github.com/apertium/apertium-weights-learner/tree/629b48b306116565bc1d748c298bc28b41506f63

https://svn.code.sf.net/p/apertium/svn/branches/weighted-transfer/

== Fixes ==
Nikita's code should work okay now. To run it, download apertium-weights-learner from https://github.com/apertium/apertium-weights-learner/tree/experimental, English - Spanish language pair with ambiguous rules from https://github.com/apertium/apertium-en-es/tree/ambiguous-rules and Apertium core with modified transfer module from https://svn.code.sf.net/p/apertium/svn/branches/weighted-transfer/apertium/.

== Coverages ==
The number of all possible coverages was calculated 100 times for 100 random sentences for 5 language pairs.

{| class = "wikitable" style = "background-color: white; text-align: center; width: 50%;"
|-
|'''language pair'''
|'''corpus'''
|'''mean number of coverages'''
|-
|English - Spanish
|Tatoeba
|3.72
|-
|English - Spanish
|Europarl
|194.35
|-
|Spanish - Catalan
|Tatoeba
|2.94
|-
|Spanish - Catalan
|Europarl
|53.04
|-
|Basque - Spanish
|Tatoeba
|9.19
|-
|Swedish - Norwegian
|Europarl
|488.57
|-
|Crimean Tatar - Turkish
|Crimean Tatar Wikipedia
|3.12
|-
|}

@@ Line 50: / Line 50: @@
 |}
-== Expertiment ==
+== Experiment ==
 The sample file new-software-sample.txt contains three selected lines with 'new software' and 'this new software' patterns, each of which triggers a pair of ambiguous rules from apertium-en-es.en-es.t1x file, namely ['adj-nom', 'adj-nom-ns'] and ['det-adj-nom', 'det-adj-nom-ns']. Speaking informally, these rules are used to transfer sequences of (adjective, noun) and (determiner, adjective, noun). The first rule in each ambiguous pair specifies that the translations of the adjective and the noun are to be swapped, which is usual for Spanish, hence these rule are specified before their '-ns' counterparts indicating that these are the default rules. The second rule in each ambiguous pair specifies that the translations of the adjective and the noun are not to be swapped, which sometimes happens and depends on lexical units involved.
+The contents of new-software-sample.txt looks like the following:
+<pre>
+Mr Stephen said the council had agreed to consider new software which would make the test more difficult.
+What's Next: Simonyi's new software writes its own code
+This new software makes it easier to get a movie done quickly, though harder to get it done well.
+</pre>
 The contents of the unpruned w1x file without generalizing patterns should look like the following:
@@ Line 264: / Line 272: @@
 </transfer-weights>
 </pre>
+This would mean that 'no-swap' versions of both rules are preferred for each pattern, which tells the transfer module that the translations of 'new' and 'software' should not be swapped (as specified in '-ns' versions of both rules), since in Spanish the adjective 'nuevo' is usually put before the noun as opposed to the fact that most adjectives are put after the noun.