Difference between revisions of "User:Khannatanmai/GSoC2020Progress"
Jump to navigation
Jump to search
Khannatanmai (talk | contribs) |
Khannatanmai (talk | contribs) |
||
| Line 5: | Line 5: | ||
* Run some experiments with the new stream format |
* Run some experiments with the new stream format |
||
* Check error handling of secondary tags in transfer (stream error, empty prefix, etc.) |
* Check error handling of secondary tags in transfer (stream error, empty prefix, etc.) |
||
| ⚫ | |||
* Modify apertium-tagger to put surface form in the stream as a secondary tag |
* Modify apertium-tagger to put surface form in the stream as a secondary tag |
||
* Modify the tagger to ignore secondary tags while pattern matching (for the tsx files) |
|||
* Modify CG to ignore secondary tags |
|||
* Modify lex-sel to ignore secondary tags while pattern matching |
|||
= Ongoing = |
= Ongoing = |
||
== Community Bonding Period (May 4 - June 1) == |
== Community Bonding Period (May 4 - June 1) == |
||
* Write tests to prepare for test driven development |
* Write tests to prepare for test driven development |
||
= Completed = |
= Completed = |
||
| Line 36: | Line 39: | ||
* Create test t1x file which covers all test cases. |
* Create test t1x file which covers all test cases. |
||
* Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer) |
* Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer) |
||
| ⚫ | |||
Revision as of 14:44, 24 May 2020
Work Plan: http://wiki.apertium.org/wiki/User:Khannatanmai/GSoC2020Proposal_Trimming#Work_Plan
Contents
To Do
Community Bonding Period (May 4 - June 1)
- Run some experiments with the new stream format
- Check error handling of secondary tags in transfer (stream error, empty prefix, etc.)
- Modify apertium-tagger to put surface form in the stream as a secondary tag
- Modify the tagger to ignore secondary tags while pattern matching (for the tsx files)
- Modify CG to ignore secondary tags
- Modify lex-sel to ignore secondary tags while pattern matching
Ongoing
Community Bonding Period (May 4 - June 1)
- Write tests to prepare for test driven development
Completed
Application Review Period (March 31 - May 3)
- Compile all the discussion about the modification to the stream format (in talk pages)
- Create dedicated page for the development of the new stream format: User:Khannatanmai/New_Apertium_stream_format
- Going through the documentation again and reading the wikis for each module just to ensure I haven't missed anything in the overall working of Apertium as I've never really made a language pair.
- http://wiki.apertium.org/wiki/User:Khannatanmai/New_Apertium_stream_format : Document modification to Apertium stream format (see talk pages for relevant discussion)
- Document how much change is needed in which parsers and what the change is
- Proof of Concept for the new format
- Document the change needed in tokeniser, bidix lookup, and generation to include surface form: User:Khannatanmai/Eliminating_Dictionary_Trimming
- Document all the proposed benefits with including secondary information
Community Bonding Period (May 4 - June 1)
- Create a suitable development and debugging environment for the pipe (Xcode)
- Modifying transfer to pass secondary tags ahead. Updates can be found here.
- Modify generator to ignore secondary tags while matching
- Deal with MLUs in generator, and special characters in sectags, etc.
- Analyse the code of the parsers of the modules
- Fix transfer behaviour with LUs with invariable parts and MLUs
- Need to deal with sec tags appearing before lemq if lemq comes from variable
- Wiki for all features being implemented for secondary tags here.
- Testcase: lemq comes from variable
- Create test t1x file which covers all test cases.
- Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer)
- Manually insert secondary tags in the stream and test if they reach the generator
