Uighur and Turkish/GSoC2018 report - Revision history

Oğuz at 13:25, 12 August 2018

2018-08-12T13:25:48Z

Oğuz: /* Commits */

2018-08-12T11:53:27Z

Commits

Oğuz: /* Corpora and Coverage */

2018-08-12T11:43:13Z

Corpora and Coverage

Oğuz: /* Corpora and Coverage */

2018-08-11T21:30:32Z

Corpora and Coverage

Oğuz: /* Corpora and Coverage */

2018-08-11T18:24:28Z

Corpora and Coverage

Oğuz: /* Sources */

2018-08-11T18:22:17Z

Sources

Oğuz: /* Sources */

2018-08-11T18:21:56Z

Sources

Oğuz at 18:18, 11 August 2018

2018-08-11T18:18:43Z

Oğuz: /* Transfer */

2018-08-11T18:18:07Z

Transfer

Oğuz: /* Transfer */

2018-08-11T18:12:08Z

Transfer

@@ Line 48: / Line 48: @@
 To determine in which context which translation of a given lemma would be selected, lexical selection is employed. Currently uig-tur has 35 lexsel rules.
+== WER results ==
+Here is the WER result before I added the unknown words/wrote some CG rules for the text:
+<pre> Test file: 'wikiwertr0.txt'
+Reference file 'wikiwertur.txt'
+Statistics about input files
+-------------------------------------------------------
+Number of words in reference: 1068
+Number of words in test: 1105
+Number of unknown words (marked with a star) in test:
+Percentage of unknown words: 0.00 %
+Results when removing unknown-word marks (stars)
+-------------------------------------------------------
+Edit distance: 394
+Word error rate (WER): 36.89 %
+Number of position-independent correct words: 731
+Position-independent word error rate (PER): 35.02 %
+Results when unknown-word marks (stars) are not removed
+-------------------------------------------------------
+Edit distance: 394
+Word Error Rate (WER): 36.89 %
+Number of position-independent correct words: 731
+Position-independent word error rate (PER): 35.02 %
+Statistics about the translation of unknown words
+-------------------------------------------------------
+Number of unknown words which were free rides: 0
+Percentage of unknown words that were free rides: 0%
+ </pre>
+And after:
+<pre>
+Test file: 'wikiwertrlast.txt'
+Reference file 'wikiwertur.txt'
+Statistics about input files
+-------------------------------------------------------
+Number of words in reference: 1068
+Number of words in test: 1065
+Number of unknown words (marked with a star) in test:
+Percentage of unknown words: 0.00 %
+Results when removing unknown-word marks (stars)
+-------------------------------------------------------
+Edit distance: 179
+Word error rate (WER): 16.76 %
+Number of position-independent correct words: 907
+Position-independent word error rate (PER): 15.07 %
+Results when unknown-word marks (stars) are not removed
+-------------------------------------------------------
+Edit distance: 179
+Word Error Rate (WER): 16.76 %
+Number of position-independent correct words: 907
+Position-independent word error rate (PER): 15.07 %
+Statistics about the translation of unknown words
+-------------------------------------------------------
+Number of unknown words which were free rides: 0
+Percentage of unknown words that were free rides: 0%
+</pre>
 ==Sources==
 I used the online [http://dict.yulghun.com/ Yulghun] dictionary and ''Uyghurche-Türkche Lughet'' of E. N. Necip for the vocabulary. For grammar reference, I used Rıdvan Öztürk's ''Yeni Uygur Türkçesi Grameri''.

@@ Line 4: / Line 4: @@
 == Commits ==
-My commits can be found [https://apertium.projectjj.com/gsoc2018/oguz/oguz.html here].
+My commits can be found [https://apertium.projectjj.com/gsoc2018/oguz/oguz.html here]. You can also download my work as a [https://apertium.projectjj.com/gsoc2018/oguz.zip zip file].
 == Corpora and Coverage ==

← Older revision		Revision as of 11:43, 12 August 2018
Line 9:		Line 9:

	== Corpora and Coverage ==		== Corpora and Coverage ==
	Our main corpora consisted of [https://www.rfa.org/uyghur/ RFA], [http://uy.ts.cn/ Tanritor], [http://www.trt.net.tr/uyghur/ TRT Uyghurche] and Uyghur Wikipedia, but we also worked on some Uyghur blogs, an collection of Uyghur stories and the Uyghur translation of the Bible to be able to cover different domains. Wikipedia and blog coverages were relatively low due to nonstandard forms, Arabic and Farsi texts and alphabets.		Our main corpora consisted of [https://www.rfa.org/uyghur/ RFA], [http://uy.ts.cn/ Tanritor], [http://www.trt.net.tr/uyghur/ TRT Uyghurche] and Uyghur Wikipedia, but we also worked on some Uyghur blogs, a collection of Uyghur stories and the Uyghur translation of the Bible to be able to cover different domains. Wikipedia and blog coverages were relatively low due to nonstandard forms, Arabic and Farsi texts and alphabets.

@@ Line 15: / Line 15: @@
 |-
 ! Corpus
+! Words
 ! Coverage
 |-
 | News
-| xx.x%
+| 3447048
+| 94.0%
 |-
 | Bible
+| 1527061
 | 94.1%
 |-
 | Wikipedia
+| 1589113
 | 88.2%
 |-
 | Blogs
-| xx.x%
+| 4055981
+| 87.0%
 |}

← Older revision		Revision as of 18:24, 11 August 2018
Line 9:		Line 9:

	== Corpora and Coverage ==		== Corpora and Coverage ==
	Our main corpora consisted of [https://www.rfa.org/uyghur/ RFA], [http://uy.ts.cn/ Tanritor], [http://www.trt.net.tr/uyghur/ TRT Uyghurche] and Uyghur Wikipedia, but we also worked on some Uyghur blogs, an collection of Uyghur stories and the Uyghur translation of the Bible to be able to cover different domains. Wikipedia and blog coverages were relatively ~~lower~~ due to nonstandard forms, Arabic and Farsi texts and alphabets.		Our main corpora consisted of [https://www.rfa.org/uyghur/ RFA], [http://uy.ts.cn/ Tanritor], [http://www.trt.net.tr/uyghur/ TRT Uyghurche] and Uyghur Wikipedia, but we also worked on some Uyghur blogs, an collection of Uyghur stories and the Uyghur translation of the Bible to be able to cover different domains. Wikipedia and blog coverages were relatively low due to nonstandard forms, Arabic and Farsi texts and alphabets.

@@ Line 46: / Line 46: @@
 ==Sources==
-I used the online [http://dict.yulghun.com/ Yulghun] dictionary and ''Uyghurche-Türkche Lughet'' of E. N. Necip the vocabulary. For grammar reference, I used Rıdvan Öztürk's ''Yeni Uygur Türkçesi Grameri''.
+I used the online [http://dict.yulghun.com/ Yulghun] dictionary and ''Uyghurche-Türkche Lughet'' of E. N. Necip for the vocabulary. For grammar reference, I used Rıdvan Öztürk's ''Yeni Uygur Türkçesi Grameri''.
 ==Future Plans==

@@ Line 38: / Line 38: @@
 Uyghur can use the '''-''rAK''''' for comparisons, which is expressed by the preposition '''daha''' in Turkish.
-===Disambiguation===
+==Disambiguation==
 To correctly discern the lemma and the morphology so as to be translated correctly into the target language, Apertium uses Constraint Grammar (CG). Currently Uyghur has about 45 CG rules for disambiguation.

@@ Line 39: / Line 39: @@
 ===Disambiguation===
-Many different analyses are generated for many word forms. To correctly discern the lemma and the morphology so as to be translated correctly into the target language, MT systems have '''disambiguation''' components. The disambiguation in this system is currently carried out using Constraint Grammar (CG). 68 rules remove the wrong analyses and select the the correct ones with the use of contextual morphological information. Ideally this would be either in conjunction with or replaced by a machine-learned POS tagger, which requires a tagged corpus. The tagged corpus will be developed in the near future.
+To correctly discern the lemma and the morphology so as to be translated correctly into the target language, Apertium uses Constraint Grammar (CG). Currently Uyghur has about 45 CG rules for disambiguation.
-===Lexical Selection===
+==Lexical Selection==
-Lexical selection is used when the system needs to choose among multiple possible translations. The lexical selection component uses rules to choose which translation to prefer based on contextual information.
+To determine in which context which translation of a given lemma would be selected, lexical selection is employed. Currently uig-tur has 35 lexsel rules.
 ==Sources==

@@ Line 33: / Line 33: @@
 There are about 50 transfer rules, mostly needed to cover Uyghur's relatively richer tense inventory. We also needed transfer rules for expression that are -optionally-
 expressed synthetically in Uyghur but was analytic in Turkish. To give some examples:
 '''''bolidighan''''' and '''''bolmaqchi''''' in Uyghur are both equivalents of Turkish '''''olacak'''''.
 Uyghur can use the '''-''rAK''''' for comparisons, which is expressed by the preposition '''daha''' in Turkish.
@@ Line 41: / Line 43: @@
 ===Lexical Selection===
 Lexical selection is used when the system needs to choose among multiple possible translations. The lexical selection component uses rules to choose which translation to prefer based on contextual information.
 ==Sources==