Difference between revisions of "User:Ilnar.salimzyan"
Jump to navigation
Jump to search
(11 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] language |
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the [[Kazakh_and_Tatar|Kazakh-Tatar]] and [[Tatar_and_Russian|Tatar-Russian]] language pairs. |
||
My [[IRC]] nick is "selimcan". |
My [[IRC]] nick is "selimcan". |
||
Line 9: | Line 9: | ||
# All (=100%) of the regression tests pass: <code>./wiki-tests.sh Regression kaz tat update</code> |
# All (=100%) of the regression tests pass: <code>./wiki-tests.sh Regression kaz tat update</code> |
||
# Corpus test doesn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> outputs 0. |
# Corpus test doesn't produce any debugging symbols: <code>./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt</code> outputs 0. |
||
# WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre> |
# WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt</pre> |
||
The same applies for the opposite direction: |
The same applies for the opposite direction: |
||
Line 15: | Line 15: | ||
# <code>./wiki-tests.sh Regression tat kaz update</code> => 100% |
# <code>./wiki-tests.sh Regression tat kaz update</code> => 100% |
||
# <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0 |
# <code>./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt</code> => 0 |
||
# The numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre> |
# The numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt</pre> are '''less than or equal to''' numbers output by <pre>kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt</pre> |
||
If and only if all test cases pass, and I don't actively work on |
If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those [[Kazakh_and_Tatar/TODO#Goals|goals]] and take care of documentation. |
||
=== TODO's related to the above === |
=== TODO's related to the above === |
||
* <code>./qa |
* <code>./qa</code> in <code>apertium-kaz-tat</code> will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible. |
||
* A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass. |
* A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass. |
||
== Notes == |
|||
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing |
|||
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Coverage |
|||
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/Wishlist |
|||
[[Category:Users]] |
[[Category:Users]] |
Latest revision as of 21:03, 1 April 2015
My name is Ilnar Salimzyanov (Илнар Сәлимҗан) and I maintain the Kazakh-Tatar and Tatar-Russian language pairs.
My IRC nick is "selimcan".
Responsibilities as the maintainer of the Kazakh-Tatar pair[edit]
Making sure that the following things are constant:
- All (=100%) of the regression tests pass:
./wiki-tests.sh Regression kaz tat update
- Corpus test doesn't produce any debugging symbols:
./qa.sh kaz-tat-corp && grep -c '[*@#]' corpa/kaz-tat-nova.txt
outputs 0. - WER continuosly decreases or at least stays the same after every commit. So, the WER numbers output by the command
kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-nova.txt -ref corpa/corpus.tat.txt
are less than or equal to numbers output bykaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/kaz-tat-origina.txt -ref corpa/corpus.tat.txt
The same applies for the opposite direction:
./wiki-tests.sh Regression tat kaz update
=> 100%./qa.sh tat-kaz-corp && grep -c '[*@#]' corpa/tat-kaz-nova.txt
=> 0- The numbers output by
kaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-nova.txt -ref corpa/corpus.kaz.txt
are less than or equal to numbers output bykaz-tat$ perl ../apertium-eval-translator/apertium-eval-translator.pl -test corpa/tat-kaz-origina.txt -ref corpa/corpus.kaz.txt
If and only if all test cases pass, and I don't actively work on another pair, I work towards achieving those goals and take care of documentation.
[edit]
./qa
inapertium-kaz-tat
will compile the transcducers and the pair and run all the tests described above. Ideally it should output a single line indicating that all tests passed and do that as quickly as possible.- A good idea would be to set up some bot which compiles apertium-kaz, apertium-tat and apertium-kaz-tat modules if somebody commits to them, runs the tests above and emails me if they don't pass.
Notes[edit]
http://wiki.apertium.org/wiki/User:Ilnar.salimzyan/On_testing