Difference between revisions of "User:SilentFlame/updatedPipeline"
Jump to navigation
Jump to search
SilentFlame (talk | contribs) |
SilentFlame (talk | contribs) |
||
Line 34: | Line 34: | ||
So to retain this in the output we handled the freeblanks between chunks. |
So to retain this in the output we handled the freeblanks between chunks. |
||
</nowiki> |
</nowiki> |
||
* Interchunk was needed to ignore the "pos" argument to '''b''' elements, and output each superblank '''exactly once''', preferably where the rule has a '''b''' element (if there are not enough b's, output the rest at the end of the rule). Here in this module we didn't deal with wordblanks, since we can't look inside chunks when in interchunk. |
* Task: Interchunk was needed to ignore the "pos" argument to '''b''' elements, and output each superblank '''exactly once''', preferably where the rule has a '''b''' element (if there are not enough b's, output the rest at the end of the rule). Here in this module we didn't deal with wordblanks, since we can't look inside chunks when in interchunk. |
||
* Category: Code enhancing |
* Category: Code enhancing |
||
* PR: https://github.com/unhammer/apertium/pull/6 |
* PR: https://github.com/unhammer/apertium/pull/6 |
||
Line 40: | Line 40: | ||
* |
* |
||
All tests mentioned in '''https://github.com/SilentFlame/apertium-1/blob/blank-handling-interchunk/tests/interchunk/__init__.py''' passes with the updated interchunk module. |
All tests mentioned in '''https://github.com/SilentFlame/apertium-1/blob/blank-handling-interchunk/tests/interchunk/__init__.py''' passes with the updated interchunk module. |
||
===Deformatters=== |
|||
* Task: Completing the prototype HTML deformatter written during the '''coding challenge''' and by the previous contributors. |
|||
* Category: Code enhancement |
|||
* PR: NOt made a PR because of need to test some more edge cases, but the entire work is at '''https://github.com/SilentFlame/apertium'''. |
|||
* Tests: https://github.com/SilentFlame/apertium/tree/master/tests |
|||
All the tests run without fail and the run command is '''$ pytyhon tests/run_test.py''' inside the apertium folder. |
|||
===Reformatters=== |
Revision as of 10:28, 26 August 2017
For the work done at Progress regarding Automatic_blank_handling
Contents
Tasks done
Pretransfer
- Task: Making pretransfer disperse tags when splitting lexical units.
- Category: Code cleanup
- PR: https://github.com/unhammer/apertium/pull/4
- Tests: https://github.com/unhammer/apertium/tree/blank-handling/tests
- personnel repo branch for all the work on pretransfer: https://github.com/SilentFlame/apertium-1/tree/blank-handling
All the pretransfer tests pass here.
Taransfer(chunker)
- Task: Fixing a memory bug which raises due to uncommenting of apertium/transfer.cc:1259 // delete[] format;
- Category: system bug
- PR: https://github.com/unhammer/apertium/pull/5
- Tests: https://github.com/unhammer/apertium/tree/blank-handling/tests
- personnel repo for the work on this module: https://github.com/SilentFlame/apertium-1/tree/blank-handling
All the tests mentioned in https://github.com/SilentFlame/apertium-1/tree/blank-handling/tests/transfer passes with the updated transfer module.
Interchunk
- Here removing "pos=1" from a "<b>" still outputs the right inline blank: This is because If given a "freeblank" which is between chunks and not a wordbound/inline blank so we need to treat it differently. let's say for example we have "^SN<sg>{^cheese<n>$}$🍰^SN<sg>{^sale<n>$}$" as an input. and the rule matches those two chunks and has an action " <out> <chunk pos="1" part="whole"/> <b/> <chunk pos="2" part="whole"/> </out> " so if here we treat "<b/>" as just a space then we'll loose "🍰" which won't give much good feel to our users. So to retain this in the output we handled the freeblanks between chunks.
- Task: Interchunk was needed to ignore the "pos" argument to b elements, and output each superblank exactly once, preferably where the rule has a b element (if there are not enough b's, output the rest at the end of the rule). Here in this module we didn't deal with wordblanks, since we can't look inside chunks when in interchunk.
- Category: Code enhancing
- PR: https://github.com/unhammer/apertium/pull/6
- Tests: https://github.com/SilentFlame/apertium-1/tree/blank-handling-interchunk/tests/interchunk
All tests mentioned in https://github.com/SilentFlame/apertium-1/blob/blank-handling-interchunk/tests/interchunk/__init__.py passes with the updated interchunk module.
Deformatters
- Task: Completing the prototype HTML deformatter written during the coding challenge and by the previous contributors.
- Category: Code enhancement
- PR: NOt made a PR because of need to test some more edge cases, but the entire work is at https://github.com/SilentFlame/apertium.
- Tests: https://github.com/SilentFlame/apertium/tree/master/tests
All the tests run without fail and the run command is $ pytyhon tests/run_test.py inside the apertium folder.