User:Jmcejuela/GSoC11Application - Revision history

Jmcejuela at 13:19, 9 April 2011

2011-04-09T13:19:27Z

Jmcejuela at 13:16, 9 April 2011

2011-04-09T13:16:57Z

Jmcejuela at 13:49, 8 April 2011

2011-04-08T13:49:28Z

Jmcejuela at 13:49, 8 April 2011

2011-04-08T13:49:03Z

Jmcejuela at 13:45, 8 April 2011

2011-04-08T13:45:49Z

Jmcejuela at 13:44, 8 April 2011

2011-04-08T13:44:49Z

Jmcejuela at 13:21, 8 April 2011

2011-04-08T13:21:06Z

Jmcejuela at 13:20, 8 April 2011

2011-04-08T13:20:08Z

Jmcejuela at 11:50, 8 April 2011

2011-04-08T11:50:25Z

Jmcejuela at 09:12, 8 April 2011

2011-04-08T09:12:34Z

@@ Line 123: / Line 123: @@
 As I've listed in the first section I have a rich experience with multiple staple tools used for machine translation: transducers, automata, HMMs, grammatical parsers, programming languages parsers, text mining, stemmers, string edit distance algorithms, fuzzy logic...
-Specifically for transducers, I've recently worked in a seminar on EM Training for Weighted Transducers and I'm about to publish a paper describing my novel conversion of such an algorithm to log space to be able to work with it on a machine in practice. This is not trivial, since both sums and vector operations are involved in the algorithm.
+Specifically for transducers, I've recently worked on a seminar on EM Training for Weighted Transducers and I'm about to publish a paper describing my novel conversion of such an algorithm to log space to be able to work with it on a machine in practice. This is not trivial, since both sums and vector operations are involved in the algorithm.
 As for open source projects, my biggest contributions are so far:

← Older revision		Revision as of 13:16, 9 April 2011
Line 3:		Line 3:
	Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers.		Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers.

	The organization for such a combined thesis/project if you accepted my proposal ~~(one thereof)~~ would be probably as follows: finally, my before possible advisor from TUM cannot supervise this thesis due to lack of time. That means, unless I can find another advisor from TUM, and if you wanted, I would need a mentor for the GSoC project and an official advisor for my thesis.		The organization for such a combined thesis/project if you accepted my proposal would be probably as follows: finally, my before possible advisor from TUM cannot supervise this thesis due to lack of time. That means, unless I can find another advisor from TUM, and if you wanted, I would need a mentor for the GSoC project and an official advisor for my thesis.

@@ Line 46: / Line 46: @@
 ''Note that being obliged to expand the GSoC project for my master thesis, I try to officially delimit the exact things I do for one and the other.''
-Project Name: '''Transducers as flag diacritics and their topology learning'''
+Project Name: '''Transducers as flag diacritics and their topology learning'''

← Older revision		Revision as of 13:49, 8 April 2011
Line 45:		Line 45:

	''Note that being obliged to expand the GSoC project for my master thesis, I try to officially delimit the exact things I do for one and the other.''		''Note that being obliged to expand the GSoC project for my master thesis, I try to officially delimit the exact things I do for one and the other.''

			Project Name: '''Transducers as flag diacritics and their topology learning'''

@@ Line 89: / Line 89: @@
-* '''Start'''
+* '''Start: transducers as flag diacritics'''
 * Week 1-3: code implementation; parallel testing & documentation
 * Week 4: code implementation; start of more formal testing

@@ Line 83: / Line 83: @@
+* '''Community Bonding Period: April 25 - May 23''':
-* '''Pre-stage''': refine project, discuss details with my mentor, advisor, and community.
+* know well Apertium's project and internals; get to know the community; know work & code standards; review C++; study Apertium's architecture and code
+* study the lttoolbox-java
+* study problem to solve; study flag diacritics approach; design plan solution for the problem
 * '''Start'''
+* Week 1-3: code implementation; parallel testing & documentation
-* Week 1-2: know well Apertium's project and procedures; get to know the community; know work & code standards; review C++; study Apertium's architecture and code
+* Week 4: code implementation; start of more formal testing
-* Week 3: study Apertium's architecture and code
-* Week 4-5: study the lttoolbox-java
+* '''Deliverable #1''': module ready for the lttoolbox-java & documentation
-* '''Deliverable #1''': possibly written description of Apertium's architecture and possible consequent contribution to Apertium's wiki documentation.
+* '''Verification on target language'''
+* Week 5: apply module to some specific language and validate correctness
+* '''Deliverable #2''': positive formal verification results
-* Week 6-7: Study the problem to solve; study flag diacritics approach; study how to solve the problem
+* '''Topology Learning'''
-* '''Deliverable #2''': formal description of the problem to solve
+* Week 6: research state-of-the-art methods and algorithms; design solution; ultimate corpus for which to apply the learning method
+* Week 7-10: implement, review, test, and document the topology learning algorithm
+* Week 11: verify algorithm
+* '''Deliverable #3''': topology learning algorithm module ready & documentation
+* '''Set & Run'''
-* Week 8-10: code implementation; parallel testing & documentation
+* Week 12: (1) Deliver transducer/flag diacritics module into official program; (2) deliver topology learning module into official program
-* Week 11: code implementation; start of more formal tests verification
-* '''Deliverable #3''': published code & documentation
-* Week 12: formal tests verification
-* '''Project Completed: Deliverable #4''': verified, merged, and runnable module code & documentation
+* '''Project Completed: Deliverable #4''': verified & delivered code & documentation

← Older revision		Revision as of 13:21, 8 April 2011
Line 3:		Line 3:
	Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers.		Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers.

	The organization for such a combined thesis/project if you accepted my proposal (one thereof) would be probably as follows: finally, my before possible advisor from TUM cannot supervise this thesis due to lack of time. That means, if you wanted, I would need a mentor for the GSoC project and an official advisor for my thesis.		The organization for such a combined thesis/project if you accepted my proposal (one thereof) would be probably as follows: finally, my before possible advisor from TUM cannot supervise this thesis due to lack of time. That means, unless I can find another advisor from TUM, and if you wanted, I would need a mentor for the GSoC project and an official advisor for my thesis.

@@ Line 1: / Line 1: @@
 I am a Master Computer Science student at Technical University of Munich (TUM), currently in my fourth-last semester and about to start my Master Thesis. As I [https://sourceforge.net/mailarchive/message.php?msg_id=27324802 announced in the mailing list] my intention is to combine into the same endeavor both my thesis and the GSoC project (possible both from my university and from Google) I desire such a combination because I want to do both but due to the entire overlap between them, considering the European/German academic calendar, it would very difficult to do them independently for both require full-time commitment.
-Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers. Furthermore, I suggest my own idea which involves mostly topology learning and weight training using one of the corpus you list in your corpora page, the [http://xixona.dlsi.ua.es/~fran/setimes/ Southeast European Times] for considering it particularly interesting due to its aligned structure for multiple languages.
+Having a solid background in transducers and their mathematical foundations, for my project I want to work extensively on transducers and this is my highest motivator. Coming from a more training/learning world, being Apertium rule-based, and also considering that my thesis should expand the work of the GSoC project to comply with a master thesis's higher effort/academic requirements (exactly 6 months at TUM), for my project I expand and elaborate further on an idea discussed with [http://wiki.apertium.org/wiki/User:Jimregan Jimregan] on the use of transducers in replacement of flag diacritics, as used in hfst, and include a part for automatic topology learning to generate such transducers.
-The organization for such a combined thesis/project if you accepted my proposal (one thereof) would be probably as follows: [http://www.sec.in.tum.de/hasan-ibne-akram/ Hasan Ibne Akram] would be my official advisor for my thesis at TUM, while one of you would be my official mentor for the GSoC project. Please tell me if you wanted to be also my official thesis advisor; we would have to discuss such possible arrangement.
+The organization for such a combined thesis/project if you accepted my proposal (one thereof) would be probably as follows: finally, my before possible advisor from TUM cannot supervise this thesis due to lack of time. That means, if you wanted, I would need a mentor for the GSoC project and an official advisor for my thesis.
@@ Line 44: / Line 44: @@
 == Which of the published tasks are you interested in? What do you plan to do? ==
+''Note that being obliged to expand the GSoC project for my master thesis, I try to officially delimit the exact things I do for one and the other.''
-As said in the introduction I propose 2 projects, which I list-link below.
+This proposal stems from (1) the suggested project by Jimmy O'Regan in an irc conversation, as a better an desired alternative to their [http://wiki.apertium.org/wiki/Ideas_for_Google_Summer_of_Code listed idea] for GSoC2011 '''Flag diacritics in lttoolbox''' using instead second level transducers, and (2) from my own expanded proposal to study and use topology-learned transducers to be placed as such 2nd level transducers.
+=== Short Description ===
+The implementation of a module to handle languages with infix inflection (and possibly other forms), to stop, according to defined constraints, useless and invalid continuation computations as flag diacritics do, for example in the HFST platform, but using instead the novel approach of a second/n level. This is approach is desired as transducers may provide greater power, expressiveness, and flexibility.
+=== Description ===
+The HFST platform uses flag diacritics to remove and stop the computation of illegal compounds, thus providing a better handling of languages with infix inflection. The Apertium project aims for this appropriate handling for such languages and, [http://wiki.apertium.org/wiki/Ideas_for_Google_Summer_of_Code/Flag_diacritics_in_lttoolbox as documented in their original idea], planned to used flag diacritics as well.
+Jimmy O'Regan suggest, however, that a better approach would be to use a second level of cascaded transducers to process the same continuations and, according to the transducers' decision, either reject the input, prune the states of the otherwise continued computation, and finally emit an epsilon symbol as flag diacritics defined by constraint rules do, or process the input and output the transducer's computation.
+The pruning of states module is already implemented in lttoolbox-java by Jacob Nordfalk, therefore my work will consist of the (1) design and implementation of such second-level, by nature cascaded n-level if considered sensible, layer of transducers, (2) the consequent changes in the FST compiling processing code and the pipeline to this other level of transducers, (3) with a limited range, verify and validate such implementation with a sample language, (4) the documentation of such development.
+Then, and more exclusively for my master thesis, with a higher research and scientific scope, I propose to study topology transducer learning to construct such n-level transducers, working with some learning corpora, and mostly using the OSTIA state-merging algorithm.
+The programming language to use will be mostly Java, using C++ if required.
+=== Contribution ===
+* The implementation of a module for the flexible handling of languages with infix inflection, and possibly other types, that makes possible to avoid the possibly infinite definition of not regular rules in a dictionary to work with more complex forms of inflection.
+* The novelty, as far as I know, of the use of transducers to tackle such a problem.
+* Altogether, a better support for languages with more complex forms of inflection.
+=== Work Plan: Timeline ===
+I mostly consider here the exact and specific work for the GSoC project, not the thesis's. The following is an estimation:
+* '''Pre-stage''': refine project, discuss details with my mentor, advisor, and community.
+* '''Start'''
+* Week 1-2: know well Apertium's project and procedures; get to know the community; know work & code standards; review C++; study Apertium's architecture and code
+* Week 3: study Apertium's architecture and code
+* Week 4-5: study the lttoolbox-java
+* '''Deliverable #1''': possibly written description of Apertium's architecture and possible consequent contribution to Apertium's wiki documentation.
+* Week 6-7: Study the problem to solve; study flag diacritics approach; study how to solve the problem
+* '''Deliverable #2''': formal description of the problem to solve
+* Week 8-10: code implementation; parallel testing & documentation
+* Week 11: code implementation; start of more formal tests verification
+* '''Deliverable #3''': published code & documentation
+* Week 12: formal tests verification
+* '''Project Completed: Deliverable #4''': verified, merged, and runnable module code & documentation
-Note that being obliged to expand the GSoC project for my master thesis, I try to officially delimit the exact things I do for the GSoC project, also to make this project more transparent for Google demands a clear specification just concerned with that project and no more time should be put into the project than the determined 3 months.
-* [[Transducers as flag diacritics and their topology learning]].
-* [[Without Name]].
 == Background & Skills ==

← Older revision		Revision as of 11:50, 8 April 2011
Line 39:		Line 39:


	My only ~~but~~ is that you don't use statistical learning. ~~Very~~ ~~bad~~ ;) In ~~any~~ ~~case,~~ I've worked ~~little before~~ with ~~rule-based~~ ~~systems~~ and so with ~~this~~ ~~project~~ I ~~will~~ be ~~able~~ to ~~learn~~ ~~and~~ ~~understand~~ ~~that~~ approach. ~~And maybe discover you're, partially, right :S~~		My only concern is that you don't use much statistical learning (recently Jimmy O'Regan told me Felipe Sánchez Martínez's statistical machine translation work) I've worked mostly with statistical methods and little with rule-based systems. I hope I can grasp a better understanding for this approach.