User:Pmodi/GSOC 2020 proposal: Hindi-Punjabi - Revision history

Pmodi at 19:32, 4 June 2020

2020-06-04T19:32:55Z

Pmodi: /* Google Translate : Analysis and comparison */

2020-04-02T06:15:27Z

Google Translate : Analysis and comparison

Pmodi: /* How and who it will benefit in society */

2020-04-02T06:14:24Z

How and who it will benefit in society

Pmodi: /* Why Google and Apertium should sponsor it */

2020-04-02T06:11:15Z

Why Google and Apertium should sponsor it

Pmodi: /* Skills */

2020-04-01T14:41:15Z

Skills

Pmodi at 15:43, 31 March 2020

2020-03-31T15:43:12Z

Pmodi: /* Why Google and Apertium should sponsor it */

2020-03-31T15:13:03Z

Why Google and Apertium should sponsor it

Pmodi: /* Why Google and Apertium should sponsor it */

2020-03-31T15:12:30Z

Why Google and Apertium should sponsor it

Pmodi: /* Why Google and Apertium should sponsor it */

2020-03-31T15:11:52Z

Why Google and Apertium should sponsor it

Pmodi: /* Why Google and Apertium should sponsor it */

2020-03-31T15:11:29Z

Why Google and Apertium should sponsor it

← Older revision		Revision as of 19:32, 4 June 2020
Line 1:		Line 1:
			Project Progress can be seen [https://wiki.apertium.org/wiki/User:Pmodi/GSOC_2020_proposal:_Hindi-Punjabi/progress here]

	== Contact Information ==		== Contact Information ==

@@ Line 63: / Line 63: @@
 <blockquote>
 '''ਚਰਚ ਨੇ todayਰਤ ਨੂੰ ਅੱਜ ਵਾਪਸ ਲਿਆਇਆ, ਉਹੀ ਪਤਲੀ womanਰਤ ਜਿਹੜੀ ਸੰਘਣੀ ਅੱਖਾਂ, ਤਿੱਖੀ ਨੱਕ ਅਤੇ ਹਨੇਰਾ ਰੰਗ. <br>'''
-''The Church brought back todayਰਤ today. The same thin woman which big-eyed, pointy nose and dark colored.''
+''The Church brought back todayਰਤ today. The same thin womanਰਤ which big-eyed, pointy nose and dark colored.''
 <br> <br>

@@ Line 43: / Line 43: @@
 === How and who it will benefit in society ===
-The Apertium community is strongly committed to under-resourced and minoritised/marginalised languages and Google helps its own way via programs like GSoC and GCI. There exists a good amount of vernacular literature and scriptures which could be circulated to a larger group of people if this project is successful. It'll be an important open source dictionary resource for both languages. My larger aim from this project is to develop a chain of pairs covering Indian languages. Since Urdu and Punjabi share their roots, at least one more pair can be developed with minimum effort. I plan on working towards the Hindi-English pair next year since by then I'll have a good understanding of the architecture a cross-language-family pair.
+The Apertium community is strongly committed to under-resourced and minoritised/marginalised languages and Google helps its own way via programs like GSoC and GCI. There exists a good amount of vernacular literature and scriptures which could be circulated to a larger group of people if this project is successful. It'll be an important open source dictionary resource for both languages. My larger aim from this project is to develop a chain of pairs covering Indian languages. Since Urdu and Punjabi share their roots, at least one more pair can be developed with minimum effort. My goal in this project will also be to properly document my design choices so that new Indic pairs can be taken up easily in subsequent years. I plan on working towards the Hindi-English pair next year since by then I'll have a good understanding of the architecture a cross-language-family pair uses.
 === Google Translate : Analysis and comparison ===

@@ Line 38: / Line 38: @@
 * Both Hindi and Punjabi are widely spoken languages, both by number of speakers and geographic spread. Despite that, Punjabi especially has very limited online resources.
 * Services like Google Translate give unsatisfactory results when it comes to translation of this pair(see Section 4.5 : Google Translate : Analysis and comparison). On the contrary, I was able to achieve close to human translation for some sentences using minimal rules and time(see Section 6 : Coding Challenge).
-* I believe the Apertium architecture is suited perfectly for this pair and can '''replace the current state-of-art translator''' for this pair.
+* I believe the Apertium architecture is suited perfectly for this pair and can '''replace the current state-of-art translator'''.
 * This is an important project(since it adds diversity to Apertium and translation systems in general) which requires at least 2-3 months of dedicated work and will be an important resource. In addition to this since it'll be publicly available, it'll drive research in vernacular languages, even in my own case(see Section 5 : Skills)
 * In my knowledge, very few attempts are made, even inside Apertium, at translation for Indian languages, the prime one headed by my lab,LTRC IIIT Hyderabad(not covering the hin-pan pair specifically). But even that project has been losing activity recently and has some issues in it's pipeline. Since these languages have a good number of speakers but not enough easily available online resources, I think it's important to work on these, given the detailed morphological analysis Apertium dictionaries offer in addition to it providing a great translation tool.

@@ Line 368: / Line 368: @@
 I've been interested in linguistics from the very beginning and due to the rigorous programming courses, I'm also adept at several programming languages like Python, C++, XML, Bash Scripting, etc. I'm skilled in writing Algorithms. Data Structures, and Machine Learning Algorithms as well.
-I also have a lot of experience studying and generating data which I feel is important especially for the problem mentioned in this proposal. My paper on ''''Hindi TimeBank: An ISO-TimeML Annotated Reference Corpus'''' recently got accepted in 16th Joint ACL - ISO Workshop on Interoperable Semantic Annotation at '''LREC 2020''' and at WILDRE-5(again LREC 2020) which presents the largest dataset for the purpose of event detection. I am working on extending the same for Punjabi using Transfer learning. ([https://sigsem.uvt.nl/isa16/ ISA list of accepted papers], [https://www.researchgate.net/publication/340266259_Hindi_TimeBank_An_ISO-TimeML_Annotated_Reference_Corpus Link to paper])
+I also have a lot of experience studying and generating data which I feel is important especially for the problem mentioned in this proposal. My paper on ''''Hindi TimeBank: An ISO-TimeML Annotated Reference Corpus'''' recently got accepted in 16th Joint ACL - ISO Workshop on Interoperable Semantic Annotation at '''LREC 2020''' and at WILDRE-5(again LREC 2020). The project enlisted in the paper presents the largest dataset for the purpose of event detection. I am working on extending the same for Punjabi using Transfer learning. ([https://sigsem.uvt.nl/isa16/ ISA list of accepted papers], [https://www.researchgate.net/publication/340266259_Hindi_TimeBank_An_ISO-TimeML_Annotated_Reference_Corpus Link to paper])
 I am also closely involved with the committee conducting Asia-Pacific Linguistics Olympiad(which holds a camp, mentors and prepares students for the International Linguistics Olympiad) and help with the organisation and judging for the same.

@@ Line 392: / Line 392: @@
 == Non-Summer-of-Code plans for the Summer ==
 Since I'll be having my college summer vacations for almost the entire duration of the project, I can easily spend 35-40 hours per week on the project. Since, the academic schedule might vary a little bit due to lock downs for prevention of COVID-19, I'll be starting work early and cover the problems in the post-application period. I've also kept workload slightly heavier in the first 2 weeks to cover up any unlikely, uncertain extensions in academics that might show up. Even then, I can spend around 20 hours a week in any case(note that this is a very unlikely situation and even then this period won't last more than a week since the coursework is already underway online and is expected to be over well before start of the project).
+[[Category:GSoC 2020 student proposals]]

@@ Line 37: / Line 37: @@
 === Why Google and Apertium should sponsor it ===
 * Both Hindi and Punjabi are widely spoken languages, both by number of speakers and geographic spread. Despite that, Punjabi especially has very limited online resources.
-* Services like Google Translate give unsatisfactory results when it comes to translation of this pair(see Section 4.5 : [[wiki.apertium.org/wiki/Pmodi/GSOC_2020_proposal:_Hindi-Punjabi#Google_Translate_:_Analysis_and_comparison]] ). On the contrary, I was able to achieve close to human translation for some sentences using minimal rules and time(see Section 6 : Coding Challenge).
+* Services like Google Translate give unsatisfactory results when it comes to translation of this pair(see Section 4.5 : [[Google Translate : Analysis and comparison]] ). On the contrary, I was able to achieve close to human translation for some sentences using minimal rules and time(see Section 6 : Coding Challenge).
 * I believe the Apertium architecture is suited perfectly for this pair and can '''replace the current state-of-art translator''' for this pair.
 * This is an important project(since it adds diversity to Apertium and translation systems in general) which requires at least 2-3 months of dedicated work and will be an important resource. In addition to this since it'll be publicly available, it'll drive research in vernacular languages, even in my own case(see Section 5 : Skills)