Difference between revisions of "User:Khannatanmai/GSoC2020Progress"

From Apertium
Jump to navigation Jump to search
Line 9: Line 9:
 
* Modify CG to ignore secondary tags
 
* Modify CG to ignore secondary tags
 
* Modify lex-sel to ignore secondary tags while pattern matching
 
* Modify lex-sel to ignore secondary tags while pattern matching
  +
* Write tests for each module to parse the new stream format
 
   
 
= Ongoing =
 
= Ongoing =
== Community Bonding Period (May 4 - June 1) ==
+
== Phase 1 (June 1 - July 4) ==
 
* Deal with the community's objections to secondary tags.
 
* Deal with the community's objections to secondary tags.
 
* Write tests for each module to parse the new stream format
   
 
= Completed =
 
= Completed =
Line 41: Line 42:
 
* Manually insert secondary tags in the stream and test if they reach the generator
 
* Manually insert secondary tags in the stream and test if they reach the generator
 
* Prepare an alternate proposal to secondary tags: [[User:Khannatanmai/Alternate_stream_modification]]
 
* Prepare an alternate proposal to secondary tags: [[User:Khannatanmai/Alternate_stream_modification]]
  +
  +
== Phase 1 (June 1 - July 4) ==

Revision as of 07:44, 1 June 2020

Work Plan: http://wiki.apertium.org/wiki/User:Khannatanmai/GSoC2020Proposal_Trimming#Work_Plan

To Do

Phase 1 (June 1 - July 4)

  • Run some experiments with the new stream format
  • Check error handling of secondary tags in transfer (stream error, empty prefix, etc.)
  • Modify apertium-tagger to put surface form in the stream as a secondary tag
  • Modify the tagger to ignore secondary tags while pattern matching (for the tsx files)
  • Modify CG to ignore secondary tags
  • Modify lex-sel to ignore secondary tags while pattern matching


Ongoing

Phase 1 (June 1 - July 4)

  • Deal with the community's objections to secondary tags.
  • Write tests for each module to parse the new stream format

Completed

Application Review Period (March 31 - May 3)

  • Compile all the discussion about the modification to the stream format (in talk pages)
  • Create dedicated page for the development of the new stream format: User:Khannatanmai/New_Apertium_stream_format
  • Going through the documentation again and reading the wikis for each module just to ensure I haven't missed anything in the overall working of Apertium as I've never really made a language pair.
  • http://wiki.apertium.org/wiki/User:Khannatanmai/New_Apertium_stream_format : Document modification to Apertium stream format (see talk pages for relevant discussion)
  • Document how much change is needed in which parsers and what the change is
  • Proof of Concept for the new format
  • Document the change needed in tokeniser, bidix lookup, and generation to include surface form: User:Khannatanmai/Eliminating_Dictionary_Trimming
  • Document all the proposed benefits with including secondary information


Community Bonding Period (May 4 - June 1)

  • Create a suitable development and debugging environment for the pipe (Xcode)
  • Modifying transfer to pass secondary tags ahead. Updates can be found here.
  • Modify generator to ignore secondary tags while matching
  • Deal with MLUs in generator, and special characters in sectags, etc.
  • Analyse the code of the parsers of the modules
  • Fix transfer behaviour with LUs with invariable parts and MLUs
  • Need to deal with sec tags appearing before lemq if lemq comes from variable
  • Wiki for all features being implemented for secondary tags here.
  • Testcase: lemq comes from variable
  • Create test t1x file which covers all test cases.
  • Run thorough regression tests on eng-spa (multi stage transfer) and spa-cat(single stage transfer)
  • Manually insert secondary tags in the stream and test if they reach the generator
  • Prepare an alternate proposal to secondary tags: User:Khannatanmai/Alternate_stream_modification

Phase 1 (June 1 - July 4)