Difference between revisions of "User:Khannatanmai/GSoC2020Progress"
Jump to navigation
Jump to search
Khannatanmai (talk | contribs) |
Khannatanmai (talk | contribs) |
||
| Line 7: | Line 7: | ||
= Ongoing = |
= Ongoing = |
||
== Phase 1 (June 1 - July 4) == |
== Phase 1 (June 1 - July 4) == |
||
* Modify |
* Modify inter chunk and post chunk to deal with wordbound blanks |
||
| Line 44: | Line 44: | ||
* Add tests an examples which have merging, splitting, deletions, insertions, etc. |
* Add tests an examples which have merging, splitting, deletions, insertions, etc. |
||
* Changed formalism so that wordbound blanks are now before an LU |
* Changed formalism so that wordbound blanks are now before an LU |
||
* Modify chunker to deal with wordbound blanks |
|||
* Write tests for the chunked |
|||
Revision as of 16:13, 5 July 2020
Work Plan: http://wiki.apertium.org/wiki/User:Khannatanmai/GSoC2020Proposal_Trimming#Work_Plan
Contents
To Do
Phase 1 (June 1 - July 4)
- Test if wordbound blanks go through the pipe properly.
Ongoing
Phase 1 (June 1 - July 4)
- Modify inter chunk and post chunk to deal with wordbound blanks
Completed
Application Review Period (March 31 - May 3)
- Compile all the discussion about the modification to the stream format (in talk pages)
- Create dedicated page for the development of the new stream format: User:Khannatanmai/New_Apertium_stream_format
- Going through the documentation again and reading the wikis for each module just to ensure I haven't missed anything in the overall working of Apertium as I've never really made a language pair.
- http://wiki.apertium.org/wiki/User:Khannatanmai/New_Apertium_stream_format : Document modification to Apertium stream format (see talk pages for relevant discussion)
- Document how much change is needed in which parsers and what the change is
- Proof of Concept for the new format
- Document the change needed in tokeniser, bidix lookup, and generation to include surface form: User:Khannatanmai/Eliminating_Dictionary_Trimming
- Document all the proposed benefits with including secondary information
Community Bonding Period (May 4 - June 1)
- Create a suitable development and debugging environment for the pipe (Xcode)
- Modifying transfer to pass secondary tags ahead. Updates can be found here.
- Modify generator to ignore secondary tags while matching
- Deal with MLUs in generator, and special characters in sectags, etc.
- Analyse the code of the parsers of the modules
- Fix transfer behaviour with LUs with invariable parts and MLUs
- Need to deal with sec tags appearing before lemq if lemq comes from variable
- Wiki for all features being implemented for secondary tags here.
- Testcase: lemq comes from variable
- Create test t1x file which covers all test cases.
- Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer)
- Manually insert secondary tags in the stream and test if they reach the generator
- Prepare an alternate proposal to secondary tags: User:Khannatanmai/Alternate_stream_modification
Phase 1 (June 1 - July 4)
- Deal with the community's objections to secondary tags.
- Come up with a method everyone is happy with
- Analyse the needs of WikiMedia's markup handling.
- New page for the development of word bound blanks: User:Khannatanmai/Wordbound_blanks
- Add tests an examples which have merging, splitting, deletions, insertions, etc.
- Changed formalism so that wordbound blanks are now before an LU
- Modify chunker to deal with wordbound blanks
- Write tests for the chunked
