Difference between revisions of "User:Ilnar.salimzyan"

From Apertium
Jump to navigation Jump to search
 
(16 intermediate revisions by the same user not shown)
Line 1: Line 1:
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] language pair.
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] and [[Tatar_and_Russian|Tatar-Russian]] language pairs.


My [[IRC]] nick is "selimcan".
My [[IRC]] nick is "selimcan".
Line 5: Line 5:
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==
== Responsibilities as the maintainer of the Kazakh-Tatar pair ==


Making sure that the following tests pass:
Making sure that the following things are constant:


* All (=100%) of the regression tests should pass: <code>./wiki-tests.sh Regression kaz tat update</code>
# All (=100%) of the regression tests pass: <code>./wiki-tests.sh Regression kaz tat update</code>
# Corpus test doesn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> outputs 0.

# WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre>
* Corpus test shouldn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> should output 0.


The same applies for the opposite direction:
The same applies for the opposite direction:


* <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
# <code>./wiki-tests.sh Regression tat kaz update</code> => 100%
# <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0
# The numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre>


If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those [[Kazakh_and_Tatar/TODO#Goals|goals]] and take care of documentation.
* <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0

If and only if all test cases pass, and I don't actively work on other pair, I work towards achiving those [[Kazakh_and_Tatar/TODO#Goals|goals]].


=== TODO's related to the above ===
=== TODO's related to the above ===


* <code>./qa</code> in <code>apertium-kaz-tat</code> will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible.
A good idea is to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the four
tests above and emails me if they don't pass.
* A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.

== Notes ==

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing


http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Coverage
Another important thing to take care of automatically is that WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the commands <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> and <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre> and <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre>.


http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Wishlist


[[Category:Users]]
[[Category:Users]]

Latest revision as of 21:03, 1 April 2015

My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the Kazakh-Tatar and Tatar-Russian language pairs.

My IRC nick is "selimcan".

Responsibilities as the maintainer of the Kazakh-Tatar pair[edit]

Making sure that the following things are constant:

  1. All (=100%) of the regression tests pass: ./wiki-tests.sh Regression kaz tat update
  2. Corpus test doesn't produce any debugging symbols: ./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt outputs 0.
  3. WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt

The same applies for the opposite direction:

  1. ./wiki-tests.sh Regression tat kaz update => 100%
  2. ./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt => 0
  3. The numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt
    are less than or equal to numbers output by
    kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt

If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those goals and take care of documentation.

TODO's related to the above[edit]

  • ./qa in apertium-kaz-tat will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible.
  • A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.

Notes[edit]

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Coverage

http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Wishlist