Difference between revisions of "User:Ilnar.salimzyan"

From Apertium
Jump to navigation Jump to search
 
(18 intermediate revisions by the same user not shown)
Line 1: Line 1:
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] language pair.
+
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] and [[Tatar_and_Russian|Tatar-Russian]] language pairs.
   
 
My [[IRC]] nick is "selimcan".
 
My [[IRC]] nick is "selimcan".
Line 5: Line 5:
 
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==
 
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==
   
Making sure that the following tests pass:
+
Making sure that the following things are constant:
   
* All (=100%) of the regression tests should pass: <code>./wiki-tests.sh Regression kaz tat update</code>
+
# All (=100%) of the regression tests pass: <code>./wiki-tests.sh Regression kaz tat update</code>
 
# Corpus test doesn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> outputs 0.
 
  +
# WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre>
* Corpus test shouldn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> should output 0.
 
   
 
The same applies for the opposite direction:
 
The same applies for the opposite direction:
   
* <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
+
# <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
 
# <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0
  +
# The numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre>
   
 
If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those [[Kazakh_and_Tatar/TODO#Goals|goals]] and take care of documentation.
* <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0
 
 
If and only if all test cases pass, I work towards achiving those [[Kazakh_and_Tatar/TODO#Goals|goals]].
 
   
 
=== TODO's related to the above ===
 
=== TODO's related to the above ===
   
  +
* <code>./qa</code> in <code>apertium-kaz-tat</code> will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible.
A good idea is to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the four tests above and emails me if they don't pass.
+
* A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.
  +
  +
== Notes ==
  +
  +
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing
  +
  +
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Coverage
  +
  +
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Wishlist
   
 
[[Category:Users]]
 
[[Category:Users]]

Latest revision as of 21:03, 1 April 2015

My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the Kazakh-Tatar and Tatar-Russian language pairs.

My IRC nick is "selimcan".

Responsibilities as the maintainer of the Kazakh-Tatar pair[edit]

Making sure that the following things are constant:

  1. All (=100%) of the regression tests pass: ./wiki-tests.sh Regression kaz tat update
  2. Corpus test doesn't produce any debugging symbols: ./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt outputs 0.
  3. WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt

The same applies for the opposite direction:

  1. ./wiki-tests.sh Regression tat kaz update => 100%
  2. ./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt => 0
  3. The numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt

If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those goals and take care of documentation.

TODO's related to the above[edit]

  • ./qa in apertium-kaz-tat will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible.
  • A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.

Notes[edit]

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Coverage

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Wishlist