Hindi and Bengali - Revision history

Gourab337: /* Hindi and Bengali for GSoC */

2021-08-25T05:45:17Z

Hindi and Bengali for GSoC

Gourab337 at 16:41, 24 August 2021

2021-08-24T16:41:02Z

Gourab337: /* Hindi and Bengali for GSoC */

2021-08-21T18:05:26Z

Hindi and Bengali for GSoC

Gourab337: Updated page

2021-08-21T18:00:27Z

Updated page

Hectoralos at 10:57, 20 August 2021

2021-08-20T10:57:09Z

Gourab337 at 07:08, 26 July 2021

2021-07-26T07:08:51Z

Gourab337 at 04:15, 26 July 2021

2021-07-26T04:15:29Z

Francis Tyers: Created page with ' {|class=wikitable ! Bengali !! Hindi !! Gloss |- | .. || .. || I drink water |- | .. || .. || I drank water |- |} *'

2013-06-05T07:07:35Z

Created page with ' {|class=wikitable ! Bengali !! Hindi !! Gloss |- | .. || .. || I drink water |- | .. || .. || I drank water |- |} *'

New page

{|class=wikitable
! Bengali !! Hindi !! Gloss
|-
| .. || .. || I drink water
|-
| .. || .. || I drank water
|-
|}

[[Category:Hindi and Bengali|*]]

@@ Line 1: / Line 1: @@
-=Hindi and Bengali for GSoC=
+=Hindi and Bengali for GSoC '21=
+This is a language pair translating between [[Hindi]] and [[Bengali]]. The project involved developing the Hindi-Bengali language pair in both directions i.e. ben-hin and hin-ben. The work involved building two dictionaries from an existing open-source project with very minimal work done, i.e., the Bengali monolingual dictionary and the Bengali-Hindi bilingual dictionary. Although it was not anticipated, several errors were found in the Hindi paradigms. So, the Hindi monolingual dictionary was modified. The Bengali dictionary was restructured too to match the Hindi dictionary.
-This is a language pair translating between [[Hindi]] and [[Bengali]].
+The work was divided over 11 weeks. The work on the Bengali and Bengali-Hindi dictionary began with working on the closed categories and later words were added according to the frequency. The work on the Hindi dictionary began after the 6th week, and several paradigms were corrected (missing tags were added, removed and reordered, and several paradigms were marked as deprecated).
+==Current Status==
+* Currently there are 7078 words excluding proper names in the monolingual dictionary and 1718 words excluding proper names in the bilingual dictionary.
+* Current coverage of Hin-Ben translator is ~67.8% and Ben-Hin translator is ~49.7%.
+* The Bengali monolingual dictionary coverage is ~72.0%.
+* [https://wiki.apertium.org/wiki/User:Gourab337/GSoC2021-Workplan-Control Workplan for GSOC '21 Ben-Hin]
 ==Goals==
@@ Line 18: / Line 27: @@
 * Add transfer rules to fix pronoun #s (obj -> obl , nom -> nom, erg conversion).
 * Write transfer rules for [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests] (Ben > Hin and Hin > Ben).
+* Add more rules in the pending tests.
 * Remove prox and dist tag in the bidix and replace it by making suitable paradigms for det.prox & det.dist (ইটা / ওটা).
+* Working on lexical selections.
-* Do disambiguation.
+* Morphological disambiguation of Hindi sentences for Hindi-Bengali translation.
-* Reduce Word Error Rate.
 ==Apertium Git Repositories==

@@ Line 1: / Line 1: @@
 =Hindi and Bengali for GSoC=
+This is a language pair translating between [[Hindi]] and [[Bengali]].
+==Goals==
+Currently the translator is very basic. We need to increase it's coverage to cover more words of the languages. We also need to add more transfer rules to cover all the [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests] to get more accurate translations.
 ==Done==
-* Closed Categories (n, adj, vblex, vbser, adv, prn, post, cnjcoo, cnjsub, cnjadv, det, num, prn, ord).
+* <s>Closed Categories (n, adj, vblex, vbser, adv, prn, post, cnjcoo, cnjsub, cnjadv, det, num, prn, ord).</s>
-* nouns, post, adj, adv, det from hitparade list.
+* <s>Most frequently used nouns, post, adj, adv, det added.</s>
-* Hin > Ben transfer rules on nouns, verbs tenses and adj.
+* <s>Hin > Ben transfer rules on nouns, verbs tenses and adj added.</s>
-* Testing scripts and test corpus.
+* <s>Testing scripts and test corpus.</s>
 ==Todo list==
-* Add more words for nouns, adjectives and verbs from hitparade list.
+* Increase coverage of translator by adding more nouns, adjectives and verbs from the list of most frequently used words in corpus. [https://wiki.apertium.org/wiki/Building_dictionaries Reference]
-* Add transfer rules to fix pronoun #s (obj -> obl , nom -> nom, erg conversion)
+* Add transfer rules to fix pronoun #s (obj -> obl , nom -> nom, erg conversion).
-* Transfer rules for [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests for Apertium-ben-hin] (Ben > Hin and Hin > Ben).
+* Write transfer rules for [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests] (Ben > Hin and Hin > Ben).
-* Lift prox and dist tag via making a suitable paradigm for det (ইটা / ওটা)
+* Remove prox and dist tag in the bidix and replace it by making suitable paradigms for det.prox & det.dist (ইটা / ওটা).
+* Do disambiguation.
+* Reduce Word Error Rate.
 ==Apertium Git Repositories==
@@ Line 18: / Line 26: @@
 *[https://github.com/apertium/apertium-hin apertium-hin]
 *[https://github.com/apertium/apertium-ben apertium-ben]
-*[https://github.com/apertium/apertium-eng-hin apertium-eng-hin]
 ==External Resources==
@@ Line 49: / Line 56: @@
 * [[Bengali]]
 * [[Hindi]]
-* [[Hindi and English]]
 [[Category:Hindi and Bengali]]

@@ Line 5: / Line 5: @@
 * Closed Categories (n, adj, vblex, vbser, adv, prn, post, cnjcoo, cnjsub, cnjadv, det, num, prn, ord).
 * nouns, post, adj, adv, det from hitparade list.
-* Hin > Ben transfer rules on nouns, verbs, tenses and adj.
+* Hin > Ben transfer rules on nouns, verbs tenses and adj.
 * Testing scripts and test corpus.

@@ Line 1: / Line 1: @@
-.[https://wiki.apertium.org/wiki/User:Gourab337/GSoC2021-Workplan-Control | Workplan for Apertium-ben-hin @ GSoc 2021]
+=Hindi and Bengali for GSoC=
-.[https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests | Pending Tests for Apertium-ben-hin]
+==Done==
-[[Category:Hindi and Bengali|*]]
+* Closed Categories (n, adj, vblex, vbser, adv, prn, post, cnjcoo, cnjsub, cnjadv, det, num, prn, ord).
+* nouns, post, adj, adv, det from hitparade list.
+* Hin > Ben transfer rules on nouns, verbs, tenses and adj.
+* Testing scripts and test corpus.
+==Todo list==
+* Add more words for nouns, adjectives and verbs from hitparade list.
+* Add transfer rules to fix pronoun #s (obj -> obl , nom -> nom, erg conversion)
+* Transfer rules for [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests for Apertium-ben-hin] (Ben > Hin and Hin > Ben).
+* Lift prox and dist tag via making a suitable paradigm for det (ইটা / ওটা)
+==Apertium Git Repositories==
+*[https://github.com/apertium/apertium-ben-hin apertium-ben-hin]
+*[https://github.com/apertium/apertium-hin apertium-hin]
+*[https://github.com/apertium/apertium-ben apertium-ben]
+*[https://github.com/apertium/apertium-eng-hin apertium-eng-hin]
+==External Resources==
+===General===
+* [https://github.com/banglakit/awesome-bangla A Useful Collection of Resources (Important)]
+* [https://en.wikipedia.org/wiki/Bengali_grammar Bengali Grammar]
+* [http://www.cal.org/heritage/pdfs/voices-hindi-language.pdf Introduction to Hindi]
+* [https://www.researchgate.net/publication/313030658_Learning_of_Hindi_Phonology_as_a_Foreigner Learning of Hindi Phonology as a Foreigner]
+* [https://benjamins.com/catalog/loall.12 Hindi by Yamuna Kachru]
+===Dictionaries===
+* http://hindi-english.org/
+* http://e-mahashabdkosh.rb-aai.in/
+* https://shabdkosh.raftaar.in/Hindi-English-Dictionary
+* http://www.aamboli.com/
+===Corpora===
+* [http://corpora.uni-leipzig.de/en?corpusId=hin_news_2011 Hindi News Corpus]
+* [https://arxiv.org/abs/1710.02855 The IIT Bombay English-Hindi Parallel Corpus]
+* [https://catalog.ldc.upenn.edu/LDC2008L02 Hindi WordNet]
+==See also==
+* [https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests Pending Tests for Apertium-ben-hin]
+* [[Bengali]]
+* [[Hindi]]
+* [[Hindi and English]]
+[[Category:Hindi and Bengali]]

← Older revision		Revision as of 10:57, 20 August 2021
Line 2:		Line 2:

	2.[https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests \| Pending Tests for Apertium-ben-hin]		2.[https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests \| Pending Tests for Apertium-ben-hin]

			[[Category:Hindi and Bengali\|*]]

← Older revision		Revision as of 07:08, 26 July 2021
Line 1:		Line 1:
	1.[https://wiki.apertium.org/wiki/User:Gourab337/GSoC2021-Workplan-Control \| Workplan for Apertium-ben-hin @ GSoc 2021]		1.[https://wiki.apertium.org/wiki/User:Gourab337/GSoC2021-Workplan-Control \| Workplan for Apertium-ben-hin @ GSoc 2021]

	2.[https://wiki.apertium.org/wiki/~~User:Gourab337~~/Pending-Tests \| Pending Tests for Apertium-ben-hin]		2.[https://wiki.apertium.org/wiki/Hindi_and_Bengali/Pending-Tests \| Pending Tests for Apertium-ben-hin]

@@ Line 1: / Line 1: @@
+.[https://wiki.apertium.org/wiki/User:Gourab337/GSoC2021-Workplan-Control | Workplan for Apertium-ben-hin @ GSoc 2021]
+.[https://wiki.apertium.org/wiki/User:Gourab337/Pending-Tests | Pending Tests for Apertium-ben-hin]
-{|class=wikitable
-! Bengali !! Hindi !! Gloss
-|-
-| .. || .. || I drink water
-|-
-| .. || .. || I drank water
-|-
-|}
-[[Category:Hindi and Bengali|*]]