Difference between revisions of "User:Khannatanmai/Wordbound blanks"

From Apertium
Jump to navigation Jump to search
(Created page with "This page will follow the development of word bound blanks in the apertium stream format. = Features = = Rationale = = Formalism = = Examples =")
 
Line 8: Line 8:


= Examples =
= Examples =
== Markup Handling ==

<pre>
$ echo 'legal <b>persons</b>' | apertium en-es -f html
Personas <b>legales</b>

$ echo 'I <b>am</b> David' | apertium en-es -f html
Soy</b> David
</pre>

<pre>
Spanish: <p>Es <s>además</s> de Valencia.</p>
Catalan: <p>És <s>a més</s> de València.</p>
</pre>

<pre>
English: <p>The <b>big <i>red</i></b> dog</p>
Spanish: <p>El perro <b><i>rojo</i> grande</b></p>
</pre>

<pre>
<p>Bees <b>cannot</b> swim</p>
<p>Las Abejas <b>no pueden</b> nadar</p>
</pre>

<pre>
<a href="Conway">Conway</a> stated that young <a href="children">children</a>
<i>“understand <a href="Object_permanence">object permanence</a>.
<a href="Concealment">Concealed</a> <a href="Object">objects</a> feature in
their awareness.”</i><span typeof="mw:Extension/ref"><a href="#ref-5">[5]</a></span>
<b>(<a href="Nielsen">Nielsen</a> equivalence).</b>
</pre>

<pre>
<p><b><i>my sister</i><br/>lives</b> <u>in Wales</u></p>
</pre>

<pre>
<a id="foobar" href="http://example.com">Foo <b>bar</b>.</a>

Ideal Output:
<a id="foobar" href="http://example.com"><b>Бар</b> фоо.</a>
</pre>

<pre>
<b>The</b> <i>sister</i>'s <em>dog</em>


== Tests ==

* https://github.com/unhammer/apertium/blob/blank-handling/tests/pretransfer/__init__.py

== Previous Attempts ==

* https://wiki.apertium.org/wiki/User:SilentFlame/Progress
* https://github.com/junaidiiith/apertium/tree/blank-handling GsoC2016 project
* https://github.com/unhammer/apertium/tree/blank-handling older, unfinished implementation of the changes required in apertium-transfer, with notes at https://github.com/unhammer/apertium/blob/blank-handling/blank_notes.org#consequences-of-this-type-of-blank-handling
* https://github.com/junaidiiith/apertium
* https://github.com/junaidiiith/Apertium_Code
* Make transfer output the non-inline blanks before the rule output AND Make transfer handle inline-blanks, and ignore <b pos="N">:: work in progress for this and the above: https://github.com/unhammer/apertium/commit/b5c73fbe82544d83a98eb16b921c2fa224f6d40c

References
* https://www.mediawiki.org/wiki/Content_translation/Developers/Markup
* https://www.mediawiki.org/wiki/Content_translation/Product_Definition/LinearDoc
* https://wiki.apertium.org/wiki/Ideas_for_Google_Summer_of_Code/superblank_handling_algorithm

Revision as of 19:02, 21 June 2020

This page will follow the development of word bound blanks in the apertium stream format.

Features

Rationale

Formalism

Examples

Markup Handling

$ echo 'legal <b>persons</b>' | apertium en-es -f html
Personas <b>legales</b>

$ echo 'I <b>am</b> David' | apertium en-es -f html
Soy</b> David
Spanish: <p>Es <s>además</s> de Valencia.</p>
Catalan: <p>És <s>a més</s> de València.</p>
English: <p>The <b>big <i>red</i></b> dog</p>
Spanish: <p>El perro <b><i>rojo</i> grande</b></p>
<p>Bees <b>cannot</b> swim</p>
<p>Las Abejas <b>no pueden</b> nadar</p>
<a href="Conway">Conway</a> stated that young <a href="children">children</a>
<i>“understand <a href="Object_permanence">object permanence</a>.
<a href="Concealment">Concealed</a> <a href="Object">objects</a> feature in
their awareness.”</i><span typeof="mw:Extension/ref"><a href="#ref-5">[5]</a></span>
<b>(<a href="Nielsen">Nielsen</a> equivalence).</b>
<p><b><i>my sister</i><br/>lives</b> <u>in Wales</u></p>
<a id="foobar" href="http://example.com">Foo <b>bar</b>.</a>

Ideal Output:
<a id="foobar" href="http://example.com"><b>Бар</b> фоо.</a>
The sister's dog


Tests

* https://github.com/unhammer/apertium/blob/blank-handling/tests/pretransfer/__init__.py

Previous Attempts

* https://wiki.apertium.org/wiki/User:SilentFlame/Progress * https://github.com/junaidiiith/apertium/tree/blank-handling GsoC2016 project * https://github.com/unhammer/apertium/tree/blank-handling older, unfinished implementation of the changes required in apertium-transfer, with notes at https://github.com/unhammer/apertium/blob/blank-handling/blank_notes.org#consequences-of-this-type-of-blank-handling * https://github.com/junaidiiith/apertium * https://github.com/junaidiiith/Apertium_Code * Make transfer output the non-inline blanks before the rule output AND Make transfer handle inline-blanks, and ignore :: work in progress for this and the above: https://github.com/unhammer/apertium/commit/b5c73fbe82544d83a98eb16b921c2fa224f6d40c References * https://www.mediawiki.org/wiki/Content_translation/Developers/Markup * https://www.mediawiki.org/wiki/Content_translation/Product_Definition/LinearDoc * https://wiki.apertium.org/wiki/Ideas_for_Google_Summer_of_Code/superblank_handling_algorithm