Difference between revisions of "User:Khannatanmai/GSoC2020Progress"
Jump to navigation
Jump to search
Khannatanmai (talk | contribs) |
Khannatanmai (talk | contribs) |
||
| Line 2: | Line 2: | ||
= To Do = |
= To Do = |
||
== |
== Phase 1 (June 1 - July 4) == |
||
* Run some experiments with the new stream format |
* Run some experiments with the new stream format |
||
* Check error handling of secondary tags in transfer (stream error, empty prefix, etc.) |
* Check error handling of secondary tags in transfer (stream error, empty prefix, etc.) |
||
| Line 9: | Line 9: | ||
* Modify CG to ignore secondary tags |
* Modify CG to ignore secondary tags |
||
* Modify lex-sel to ignore secondary tags while pattern matching |
* Modify lex-sel to ignore secondary tags while pattern matching |
||
* Write tests for each module to parse the new stream format |
|||
= Ongoing = |
= Ongoing = |
||
Revision as of 07:44, 1 June 2020
Work Plan: http://wiki.apertium.org/wiki/User:Khannatanmai/GSoC2020Proposal_Trimming#Work_Plan
Contents
To Do
Phase 1 (June 1 - July 4)
- Run some experiments with the new stream format
- Check error handling of secondary tags in transfer (stream error, empty prefix, etc.)
- Modify apertium-tagger to put surface form in the stream as a secondary tag
- Modify the tagger to ignore secondary tags while pattern matching (for the tsx files)
- Modify CG to ignore secondary tags
- Modify lex-sel to ignore secondary tags while pattern matching
- Write tests for each module to parse the new stream format
Ongoing
Community Bonding Period (May 4 - June 1)
- Deal with the community's objections to secondary tags.
Completed
Application Review Period (March 31 - May 3)
- Compile all the discussion about the modification to the stream format (in talk pages)
- Create dedicated page for the development of the new stream format: User:Khannatanmai/New_Apertium_stream_format
- Going through the documentation again and reading the wikis for each module just to ensure I haven't missed anything in the overall working of Apertium as I've never really made a language pair.
- http://wiki.apertium.org/wiki/User:Khannatanmai/New_Apertium_stream_format : Document modification to Apertium stream format (see talk pages for relevant discussion)
- Document how much change is needed in which parsers and what the change is
- Proof of Concept for the new format
- Document the change needed in tokeniser, bidix lookup, and generation to include surface form: User:Khannatanmai/Eliminating_Dictionary_Trimming
- Document all the proposed benefits with including secondary information
Community Bonding Period (May 4 - June 1)
- Create a suitable development and debugging environment for the pipe (Xcode)
- Modifying transfer to pass secondary tags ahead. Updates can be found here.
- Modify generator to ignore secondary tags while matching
- Deal with MLUs in generator, and special characters in sectags, etc.
- Analyse the code of the parsers of the modules
- Fix transfer behaviour with LUs with invariable parts and MLUs
- Need to deal with sec tags appearing before lemq if lemq comes from variable
- Wiki for all features being implemented for secondary tags here.
- Testcase: lemq comes from variable
- Create test t1x file which covers all test cases.
- Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer)
- Manually insert secondary tags in the stream and test if they reach the generator
- Prepare an alternate proposal to secondary tags: User:Khannatanmai/Alternate_stream_modification
