Crimean Tatar and Turkish/Work plan - Revision history

Memduh at 18:27, 19 June 2017

2017-06-19T18:27:25Z

Ilnar.salimzyan at 20:57, 11 June 2017

2017-06-11T20:57:21Z

Ilnar.salimzyan at 20:56, 11 June 2017

2017-06-11T20:56:27Z

Ilnar.salimzyan at 17:09, 7 June 2017

2017-06-07T17:09:10Z

Ilnar.salimzyan: /* Weekly Schedule */

2017-06-07T17:08:20Z

Weekly Schedule

Ilnar.salimzyan at 01:37, 7 June 2017

2017-06-07T01:37:04Z

Ilnar.salimzyan at 00:56, 7 June 2017

2017-06-07T00:56:09Z

Ilnar.salimzyan at 23:27, 6 June 2017

2017-06-06T23:27:36Z

Francis Tyers at 11:01, 28 May 2017

2017-05-28T11:01:21Z

Ilnar.salimzyan at 01:51, 27 May 2017

2017-05-27T01:51:27Z

@@ Line 3: / Line 3: @@
 |-
-| 3  ||22nd May &mdash; 28th May || 40% || 43.9% ||
+| 3  ||22nd May &mdash; 28th May || 40% || 43.9% || '''✔'''
 |-
@@ Line 15: / Line 15: @@
 |-
-| 4  ||29th May &mdash; 4th June || 40% || ||
+| 4  ||29th May &mdash; 4th June || 40% || || '''✔'''
 |-
@@ Line 21: / Line 21: @@
 |-
-| 5  ||5th June &mdash; 11th June || 65%  || ||
+| 5  ||5th June &mdash; 11th June || 65%  || || '''✔'''
 |-
@@ Line 27: / Line 27: @@
 |-
-| 6  ||12th June &mdash; 18th June || 75%  || ||
+| 6  ||12th June &mdash; 18th June || 75%  || || '''✔'''
 |-

@@ Line 51: / Line 51: @@
 |-
-| 9  ||3rd July &mdash; 9th July || 82%  || ||
+| 9  ||3rd July &mdash; 9th July || 84%  || ||
 |-

@@ Line 27: / Line 27: @@
 |-
-| 6  ||12th June &mdash; 18th June || 70%  || ||
+| 6  ||12th June &mdash; 18th June || 75%  || ||
 |-

@@ Line 1: / Line 1: @@
-What [[User:Ilnar.salimzyan|selimcan]] expects:
-* '''a bidirectional Crimean Tatar-Turkish translator for translating Wikipedia articles''', with:
-** >90% [[Calculating coverage|bidix-trimmed coverage]] on both Wikipedias,
-** [[Testvoc#Corpus testvoc|Wikipedia-corpus-testvoc]] and single-stem-per-lexicon-testvoc clean in both directions,
-** [[WER]] < 25% in both directions.
 {|class=wikitable
 ! Week !! Dates                 !!  Coverage !! Achieved !! Evaluation

@@ Line 6: / Line 6: @@
 ** [[WER]] < 25% in both directions.
-== Weekly Schedule ==
-{|class=wikitable
-|-
-!rowspan="2"| Week !!rowspan="2"| Dates !!colspan="3"| Target !! !!colspan="3"| Achieved !!rowspan="2"| Evaluation
-|-
-! crh-tur cov. !! tur-crh cov. !! testvoc !! !! crh-tur cov. !! tur-crh cov. !! testvoc
-|-
-| 1   || 07/06&mdash;11/06
-| 65% || 65% || pronouns || || || || ||
-|-
-|-
-| 12  || 21/08&mdash;27/08
-| 90% || 90% || all categories || || || || ||
-|}
-=== Coverage ===
-To measure the bidix-trimmed coverage, use <code>apertium-crh-tur/testvoc/corpus/trimmed-coverage.sh</code>:
-<pre>
-apertium-crh-tur$ bzcat ~/src/turkiccorpora/crh.wpdump.20151123.txt.bz2 | \
-                  bash testvoc/corpus/trimmed-coverage.sh | less
-Number of tokenised words in the corpus:         148013
-Number of tokenised words unknown to analyser:    63730  —  43.1 % of tokens had *
-                          unknown to bidix:         112  —   0.1 % of tokens had @
-     w/transfer errors or unknown to generator:    2473  —   1.7 % of tokens had #
-Error-free coverage of analyser only:             84283  —  56.9 % of tokens had no *
-Error-free coverage of analyser and bidix:        84171  —  56.9 % of tokens had no */@
-Error-free coverage of the full translator:       81698  —  55.2 % of tokens had no */@/#
-Top unknown words in the corpus:
-^*Ukrainanıñ$
-^*vilâyetinde$
-^*şeklinde$
-^*qasaba$
-^*merkezi$
-^*rayonınıñ$
-^*da$
-^*de$
-^*adı$
-^*vilâyeti$
-Tokens needed to get 65.0 % bidix-trimmed coverage (no */@/#): 12037
-Storing corresponding wordlist in /tmp/corpus-stat-all-needed.txt
-^Baş<n><nom>$   Baş
-^*Saife$        *Saife
-...
-</pre>
-=== Testvoc ===
-Requirements for testvoc in week 1:
-# all pronouns from Wikipedia are translated without debug symbols
-# all pronouns transducers generate must pass without debug symbols  (this is less important, and only to focus on if done with 1)
-To achieve 1:
-* analyse corpora with crh-morph/tur-morph mode
-* grep pronouns
-* make sure they pass through the rest of the pipeline without getting @ or #
-To achieve 2:
-* in 'Root' lexicon of the .lexc files, comment out everything except Pronouns
-* generate pronouns with <code>hfst-fst2string crh/tur.automorf.hfst</code>
-* make sure they pass through the rest of the pipeline without getting @ or #
-We don't want to spend too much time on forms which are probably over-generated by the transducers. This is the reason why we focus on 1 first.
-----
-This plan below might change.
 {|class=wikitable
@@ Line 218: / Line 138: @@
 |-
 |}
+=== Coverage ===
+To measure the bidix-trimmed coverage, use <code>apertium-crh-tur/testvoc/corpus/trimmed-coverage.sh</code>:
+<pre>
+apertium-crh-tur$ bzcat ~/src/turkiccorpora/crh.wpdump.20151123.txt.bz2 | \
+                  bash testvoc/corpus/trimmed-coverage.sh | less
+Number of tokenised words in the corpus:         148013
+Number of tokenised words unknown to analyser:    63730  —  43.1 % of tokens had *
+                          unknown to bidix:         112  —   0.1 % of tokens had @
+     w/transfer errors or unknown to generator:    2473  —   1.7 % of tokens had #
+Error-free coverage of analyser only:             84283  —  56.9 % of tokens had no *
+Error-free coverage of analyser and bidix:        84171  —  56.9 % of tokens had no */@
+Error-free coverage of the full translator:       81698  —  55.2 % of tokens had no */@/#
+Top unknown words in the corpus:
+^*Ukrainanıñ$
+^*vilâyetinde$
+^*şeklinde$
+^*qasaba$
+^*merkezi$
+^*rayonınıñ$
+^*da$
+^*de$
+^*adı$
+^*vilâyeti$
+Tokens needed to get 65.0 % bidix-trimmed coverage (no */@/#): 12037
+Storing corresponding wordlist in /tmp/corpus-stat-all-needed.txt
+^Baş<n><nom>$   Baş
+^*Saife$        *Saife
+...
+</pre>
+=== Testvoc ===
+Requirements for testvoc in week 1:
+# all pronouns from Crimean Tatar corpora  are translated without debug symbols
+# all pronouns the transducer generates must pass without debug symbols  (this is less important, and only to focus on if done with 1)
+To achieve 1:
+* analyse corpora with crh-morph mode
+* grep pronouns
+* make sure they pass through the rest of the pipeline without getting @ or #
+To achieve 2:
+* in 'Root' lexicon of the .lexc file, comment out everything except Pronouns
+* generate pronouns with <code>hfst-fst2string crh.automorf.hfst</code>
+* make sure they pass through the rest of the pipeline without getting @ or #
+We don't want to spend too much time on forms which might be over-generated by the transducer. This is the reason why we focus on 1 first.
 [[Category:Crimean Tatar and Turkish|Work plan]]

← Older revision		Revision as of 11:01, 28 May 2017
Line 1:		Line 1:
	What [[User:~~IlnarSalimzyan~~\|selimcan]] expects:		What [[User:Ilnar.salimzyan\|selimcan]] expects:

	* [[Calculating coverage\|Bidix-trimmed coverage]] 90% on all Crimean Tatar corpora we have.		* [[Calculating coverage\|Bidix-trimmed coverage]] 90% on all Crimean Tatar corpora we have.

@@ Line 3: / Line 3: @@
 * [[Calculating coverage|Bidix-trimmed coverage]] 90% on all Crimean Tatar corpora we have.
 * [[Testvoc#Corpus testvoc|Corpus testvoc]] clean on all corpora.
-* Tests in [[Crimean Tatar and Turkish/Pending tests|Pending tests]] pass and thus are moved to [[Crimean Tatar and Turkish/Regression tests|Regression tests]]
+* Tests in [[Crimean Tatar and Turkish/Pending tests|Pending tests]] pass and thus are moved to [[Crimean Tatar and Turkish/Regression tests|Regression tests]].
 {|class=wikitable