Tatar and Bashkir/GSOC 2018 - Revision history

Zu-ann at 13:17, 14 August 2018

2018-08-14T13:17:23Z

Zu-ann at 22:00, 13 August 2018

2018-08-13T22:00:47Z

Zu-ann at 21:57, 13 August 2018

2018-08-13T21:57:53Z

Zu-ann at 21:54, 13 August 2018

2018-08-13T21:54:49Z

Zu-ann at 21:50, 13 August 2018

2018-08-13T21:50:59Z

Zu-ann at 21:18, 13 August 2018

2018-08-13T21:18:54Z

Zu-ann at 20:04, 13 August 2018

2018-08-13T20:04:05Z

Zu-ann at 20:01, 13 August 2018

2018-08-13T20:01:04Z

Zu-ann at 09:05, 10 August 2018

2018-08-10T09:05:26Z

Zu-ann at 01:16, 10 August 2018

2018-08-10T01:16:58Z

@@ Line 28: / Line 28: @@
 |Before|| ~ 26 400 lemmas || ~ 2 800 lemmas || ~ 2 600 lemmas || tat-bak: 72.00%, bak-tat: 68.63%
 |-
-|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ~ 50 000 lemmas ||  tat-bak: 87.56%, bak-tat: 87.93%
+|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ~ 50 000 lemmas ||  tat-bak: 87.56%, bak-tat: 88.98%
 |}
+Bilingual coverage was calculated using aq-covtest (http://wiki.apertium.org/wiki/Apertium-quality/Application_Documentation) and Wikipedia dumps (https://dumps.wikimedia.org/ttwiki/20180801/ and https://dumps.wikimedia.org/bawiki/20180801/).
 ==Future work==

@@ Line 33: / Line 33: @@
 ==Future work==
-* Continue improving Bashkir monolingual transducer to make more possible word forms analyzed.
+* Continue improving Bashkir monolingual transducer to make more word forms analyzed.
 * Continue improving the coverage.
 * Check (and fix if necessary) the words, mostly proper nouns, which were added using auto translation.

@@ Line 3: / Line 3: @@
 ==List of commits==
-The list of all my commits can be found here: https://apertium.projectjj.com/gsoc2018/zu-ann/zu-ann.html.
+The list of all the commits can be found here: https://apertium.projectjj.com/gsoc2018/zu-ann/zu-ann.html.
 tar.gz with commits can be downloaded here: https://apertium.projectjj.com/gsoc2018/zu-ann.tar.gz.

@@ Line 26: / Line 26: @@
 | ||'''tat.lexc''' || '''bak.lexc''' || '''bidix''' || '''Bilingual Coverage'''
 |-
-|Before|| ~ 26 400 lemmas || ~ 2 800 lemmas || ~ 2 600 lemmas || tat-bak: 72.00%, bak-tat: 68.63% ||
+|Before|| ~ 26 400 lemmas || ~ 2 800 lemmas || ~ 2 600 lemmas || tat-bak: 72.00%, bak-tat: 68.63%
 |-
-|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ~ 50 000 lemmas ||  tat-bak: 87.56%, bak-tat: 87.93%||
+|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ~ 50 000 lemmas ||  tat-bak: 87.56%, bak-tat: 87.93%
 |}
@@ Line 36: / Line 36: @@
 * Continue improving the coverage.
 * Check (and fix if necessary) the words, mostly proper nouns, which were added using auto translation.
-* Revise the dictionaries and drop duplicates.
+* Revise the dictionaries.

@@ Line 24: / Line 24: @@
 {|class="wikitable"
-| ||'''tat.lexc''' || '''bak.lexc''' || '''bak.twol''' || '''bidix''' || '''Bilingual Coverage'''
+| ||'''tat.lexc''' || '''bak.lexc''' || '''bidix''' || '''Bilingual Coverage'''
 |-
-|Before|| || || || tat-bak: 72.00%, bak-tat: 68.63% ||
+|Before|| ~ 26 400 lemmas || ~ 2 800 lemmas || ~ 2 600 lemmas || tat-bak: 72.00%, bak-tat: 68.63% ||
 |-
-|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ||  tat-bak: 87.56%, bak-tat: 87.93%||
+|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ~ 50 000 lemmas ||  tat-bak: 87.56%, bak-tat: 87.93%||
 |}

@@ Line 26: / Line 26: @@
 | ||'''tat.lexc''' || '''bak.lexc''' || '''bak.twol''' || '''bidix''' || '''Bilingual Coverage'''
 |-
-|Before|| || || || tat-bak: 72.00% bak-tat: 68.63% ||
+|Before|| || || || tat-bak: 72.00% | bak-tat: 68.63% ||
 |-
-|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ||  tat-bak: 87.56% bak-tat: ||
+|After|| ~ 56 900 lemmas || ~ 56 000 lemmas || ||  tat-bak: 87.56% | bak-tat: 87.93%||
 |}

@@ Line 1: / Line 1: @@
-This is the report for Google Summer of Code 2018 project — Tatar-Bashkir machine translation.
+This is the report for [https://summerofcode.withgoogle.com/projects/#5878649350258688 Google Summer of Code 2018 project] — Tatar-Bashkir machine translation.
 ==List of commits==
-* The list of all my commits can be found here: https://apertium.projectjj.com/gsoc2018/zu-ann/zu-ann.html.
+The list of all my commits can be found here: https://apertium.projectjj.com/gsoc2018/zu-ann/zu-ann.html.
-* tar.gz with commits can be downloaded here: https://apertium.projectjj.com/gsoc2018/zu-ann.tar.gz.
-* zip with commits can be downloaded here: https://apertium.projectjj.com/gsoc2018/zu-ann.zip.
+tar.gz with commits can be downloaded here: https://apertium.projectjj.com/gsoc2018/zu-ann.tar.gz.
+zip with commits can be downloaded here: https://apertium.projectjj.com/gsoc2018/zu-ann.zip.
 ==What was done==
-* Lexicons in bak.lexc were changed to correspond to the ones in tat.lexc, missing lexicons and tags were added to bak.lexc and new rules were added to bak.twol.
+Lexicons in bak.lexc were changed to correspond to the ones in tat.lexc, missing lexicons and tags were added to bak.lexc and new rules were added to bak.twol.
-* The stems from tat.lexc were translated into Bashkir and added to bak.lexc and bidix.
-* Words from the Bashkir frequency list http://lcph.bashedu.ru/index.php?go=wikilist_lemmas were translated into Tatar and added to tat.lexc and bidix.
+The stems from tat.lexc were translated into Bashkir and added to bak.lexc and bidix.
-* Using Russian-Tatar and Russian-Bashkir dictionaries new stems were added to tat.lexc, bak.lexc and bidix.
-* Using Wikidata new toponyms were added to tat.lexc, bak.lexc and bidix.
+Words from the Bashkir frequency list http://lcph.bashedu.ru/index.php?go=wikilist_lemmas were translated into Tatar and added to tat.lexc and bidix.
+Using Russian-Tatar and Russian-Bashkir dictionaries new stems were added to tat.lexc, bak.lexc and bidix.
+Using Wikidata new toponyms were added to tat.lexc, bak.lexc and bidix.
 ==Statistics==