Difference between revisions of "User:Ilnar.salimzyan"

From Apertium
Jump to navigation Jump to search
Line 5: Line 5:
 
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==
 
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==
   
Making sure that the following tests pass:
+
Making sure that the following things are constant:
   
* All (=100%) of the regression tests should pass: <code>./wiki-tests.sh Regression kaz tat update</code>
+
# All (=100%) of the regression tests pass: <code>./wiki-tests.sh Regression kaz tat update</code>
 
# Corpus test doesn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> outputs 0.
 
 
# WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre>.
* Corpus test shouldn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> should output 0.
 
   
 
The same applies for the opposite direction:
 
The same applies for the opposite direction:
   
* <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
+
# <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
 
# <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0
  +
# The numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre>.
   
 
If and only if all test cases pass, and I don't actively work on an other pair, I work towards achieving those [[Kazakh_and_Tatar/TODO#Goals|goals]] and take care of documentation.
* <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0
 
 
If and only if all test cases pass, and I don't actively work on an other pair, I work towards achiving those [[Kazakh_and_Tatar/TODO#Goals|goals]] and take care of documentation.
 
   
 
=== TODO's related to the above ===
 
=== TODO's related to the above ===
   
A good idea is to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the four
+
<code>./qa.sh all</code> in <code>apertium-kaz-tat</code> will compile the transcducers and the pair and run all the tests described above (note that you have to <code>mv corpa/kaz-tat-nova.txt corpa/kaz-tat-origina.txt</code> before you run tests if you want to see how the last commit affected them (not how the last+second_to_last commits did that). A good idea would be, however, to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.
tests above and emails me if they don't pass.
 
 
Another important thing to take care of automatically is that WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the commands <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> and <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre> and <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre>
 
   
 
[[Category:Users]]
 
[[Category:Users]]

Revision as of 00:21, 21 March 2014

My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the Kazakh-Tatar language pair.

My IRC nick is "selimcan".

Responsibilities as the maintainer of the Kazakh-Tatar pair

Making sure that the following things are constant:

  1. All (=100%) of the regression tests pass: ./wiki-tests.sh Regression kaz tat update
  2. Corpus test doesn't produce any debugging symbols: ./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt outputs 0.
  3. WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt
    .

The same applies for the opposite direction:

  1. ./wiki-tests.sh Regression tat kaz update => 100%
  2. ./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt => 0
  3. The numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt
    .

If and only if all test cases pass, and I don't actively work on an other pair, I work towards achieving those goals and take care of documentation.

TODO's related to the above

./qa.sh all in apertium-kaz-tat will compile the transcducers and the pair and run all the tests described above (note that you have to mv corpa/kaz-tat-nova.txt corpa/kaz-tat-origina.txt before you run tests if you want to see how the last commit affected them (not how the last+second_to_last commits did that). A good idea would be, however, to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.