Difference between revisions of "Bosnian-Croatian-Montenegrin-Serbian and Slovenian"

From Apertium
Jump to navigation Jump to search
 
(61 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Description about this project will be added soon.
Description about this project will be added soon.

==Source==

<pre>
https://apertium.svn.sourceforge.net/svnroot/apertium/trunk/apertium-hbs-slv
</pre>


==Work plan==
==Work plan==


This is a draft workplan for development of the Serbo-Croatian and Slovenian translator.
This is a draft workplan for development of the Bosnian-Croatian-Montenegrin-Serbian and Slovenian translator.


* Trimmed coverage means the coverage of both of the morphological analysers after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary.
* Trimmed coverage means the coverage of both of the morphological analysers after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary.
Line 11: Line 17:
{|class=wikitable
{|class=wikitable
|-
|-
! Week !! Dates !! Trimmed coverage !! Testvoc !! Evaluation !! Notes
! Week !! Dates !! Trimmed coverage !! Reached !! Testvoc !! Evaluation !! Notes
|-
|-
| 0 || 23/04&mdash;21/05 || 45% || {{tag|abbr}} {{tag|ij}} || 500 words || '''Preliminary evaluation'''. Translate the story total coverage and without diagnostics. Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
| 0 || 23/04&mdash;21/05 || 45% || || {{tag|abbr}} {{tag|ij}} || 500 words || '''Preliminary evaluation'''. Translate the story in both directions with total coverage and without diagnostics. Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
|-
|-
| 1 || 21/05&mdash;27/05 || 50% || {{tag|num}} {{tag|pr}} || - || Basic numerals, and postpositions should be clean.
| 1 || 21/05&mdash;27/05 || 50% || || {{tag|cnjcoo}} {{tag|cnjadv}} {{tag|cnjsub}} {{tag|pr}} || - || Conjunctions and prepositions should be clean. Verbs should be tagged for transitivity.
|-
|-
| 2 || 28/05&mdash;03/06 || 53% || {{tag|cnjcoo}} {{tag|cnjadv}} {{tag|cnjsub}} || - ||
| 2 || 28/05&mdash;03/06 || 53% || || {{tag|adv}} || - ||
|-
|-
| 3 || 04/06&mdash;10/06 || 59% || {{tag|adv}} || 200 words || Work on disambiguation.
| 3 || 04/06&mdash;10/06 || 59% || || {{tag|num}} || 200 words || Work on disambiguation. Numerals should be clean.
|-
|-
| 4 || 11/06&mdash;17/06 || 63% || {{tag|prn}} {{tag|det}} || - ||
| 4 || 11/06&mdash;17/06 || 63% || || {{tag|prn}} {{tag|det}} || - ||
|-
|-
| 5 || 18/06&mdash;24/06 || 68% || {{tag|n}} || - ||
| 5 || 18/06&mdash;24/06 || 68% || || {{tag|n}} || - ||
|-
|-
| 6 || 25/06&mdash;01/07 || 70% || {{tag|adj}} || 500 words || '''Midterm evaluation'''. Work on disambiguation.
| 6 || 25/06&mdash;01/07 || 70% || || {{tag|adj}} || 500 words || '''Midterm evaluation'''. Work on disambiguation.
|-
|-
| 7 || 02/07&mdash;08/07 || 73% || - || - ||
| 7 || 02/07&mdash;08/07 || 73% || || - || - ||
|-
|-
| 8 || 09/07&mdash;15/07 || 75% || - || - ||
| 8 || 09/07&mdash;15/07 || 75% || || - || - ||
|-
|-
| 9 || 16/07&mdash;22/07 || 77% || - || 200 words || Work on disambiguation.
| 9 || 16/07&mdash;22/07 || 77% || || - || 200 words || Work on disambiguation.
|-
|-
| 10 || 23/07&mdash;29/07 || 80% || {{tag|vblex}} || - ||
| 10 || 23/07&mdash;29/07 || 80% || || {{tag|vblex}} || - ||
|-
|-
| 11 || 30/07&mdash;05/08 || 80% || - || - || Work on disambiguation.
| 11 || 30/07&mdash;05/08 || - || || - || - || Closed categories clean.
|-
|-
| 12 || 06/08&mdash;12/08 || 80% || ''all categories clean'' || 500 words || '''Final evaluation'''. Tidying up, releasing
| 12 || 06/08&mdash;12/08 || - || || - || - || Open categories clean.
|-
| 13 || 13/08&mdash;19/08 || - || || - || - || Disambiguation and transfer.
|-
| 14 || 20/08&mdash;24/08 || - || || - || - || '''Final evaluation'''. Tidying up, releasing
|-
|-
|}
|}


== Improving coverage - A two week report ==

The work on improving the coverage for the slovenian -> bosnian-croatian-montenegrin-serbian language pair should be done 4 hours per day, for two weeks straight. <br />
Day 0 denotes the current state of the language pair, and each subsequent entry will denote the coverage and testvoc reached for that day.

The corpora used for this task can be found here: http://www.statmt.org/europarl/v7/sl-en.tgz

Coverage was calculated using the following script

<pre>

echo total;
cat europarl-v7.sl-en.sl | apertium -d ~/Apertium/apertium-sh-sl/ sl-sh-morph | sed 's/\$[^\^]*\^/$\n^/g' | wc -l
# This expression evaluates to 14340199

echo unknown;
cat europarl-v7.sl-en.sl | apertium -d ~/Apertium/apertium-sh-sl/ sl-sh-morph | sed 's/\$[^\^]*\^/$\n^/g' | grep '*' | wc -l

coverage = 1 - unknown / total

</pre>



{|class=wikitable
|-
! Dat !! Dates !! Coverage reached !! Coverage reached (2) !! Target !! Notes
|-
|-
| 0 || 20-02-2013 || 87.12% || - || - ||
|-
| 1 || 01-03-2013 || 88.39% || - || [87.56, 88.24] ||
|-
| 2 || 02-03-2013 || 90.05% || - || [87.78, 88.80] ||
|-
| 3 || 03-03-2013 || 91.53% || - || [88.00, 89.36] ||
|-
| 4 || 04-03-2013 || 92.36% || - || [88.22, 89.93] ||
|-
| 5 || 05-03-2013 || 92.95% || - || [88.44, 90.49] ||
|-
| 6 || 06-03-2013 || 93.55% || - || [88.66, 91.05] ||
|-
| 7 || 07-03-2013 || 94.11% || - || [88.88, 91.61] ||
|-
| 8 || 08-03-2013 || 94.54% || - || [89.10, 92.17] ||
|-
| 9 || 09-03-2013 || 94.95% || 87.52% || [89.32, 92.74] ||
|-
| 10 || 10-03-2013 || 95.11% || 91.46% || [89.54, 93.30] ||
|-
| 11 || 11-03.2013 || 95.26% || || [89.76, 93.86] ||
|-
| 12 || 13-03-2013 || 95.41% || 93.23% || [89.98, 94.42] ||
|-
| 13 || 15-03-2013 || 95.50% || 93.57% || [90.20, 94.99] ||
|-
| 14 || || || || [90.00, 95.00] ||
|-
|}

The work on improving the coverage for the slovenian -> bosnian-croatian-montenegrin-serbian language pair should be done 2 hours per day, for two weeks straight. <br />
The two tasks do not have to be run in parallel.


{|class=wikitable
|-
! Day !! Dates !! Testvoc reached !! Notes
|-
|-
| 0 || 26-03-2013 || 99.76% || Regional variants added, some translation mistakes ironed out, a cpl of transfer rules
|-
| 1 || 28-03-2013 || 99.81% || Nouns, proper nouns and number categories clean
|-
| 2 || 02-04-2013 || 99.87%|| Verbs clean
|-
| 3 || 03-04-2013 ||99.90% || Adjectives clean sl->bhs
|-
| 4 || 04-04-2013 ||99.92% || Adverbs almost clean
|-
| 5 || 05-04-2013 || 99.93% || Adverbs bhs->sl left
|-
| 6 || 06-04-2013 || 100% || Testvoc clean
|-
| 7 || 09-04-2013 || 100% || Strange generation errors cleaned
|-
| 8 || 14-04-2013 || 100% || Generation duplicates cleaned
|-
| 9 || 15-04-2013 || 100% || 20 transfer rules added
|-
| 10 || 16-04-2013 || 100% || 21 transfer rules added
|-
| 11 || 17-04-2013 || 100% || particles that testvoc didn't catch clean
|-
| 12 || 18-04-2013 || 100% || numerals uncaught by testvoc cleaned
|-
| 13 || || ||
|-
| 14 || || ||
|-
|}


==See also==
* [[TODOs for the article]]
* [[/Press release]]


[[Category:Serbo-Croatian and Slovenian|*]]
[[Category:Bosnian-Croatian-Montenegrin-Serbian and Slovenian|*]]

Latest revision as of 16:54, 1 July 2013

Description about this project will be added soon.

Source[edit]

https://apertium.svn.sourceforge.net/svnroot/apertium/trunk/apertium-hbs-slv

Work plan[edit]

This is a draft workplan for development of the Bosnian-Croatian-Montenegrin-Serbian and Slovenian translator.

  • Trimmed coverage means the coverage of both of the morphological analysers after being trimmed according to the bilingual dictionary of the pair, that is, only containing stems which are also in the bilingual dictionary.
  • Testvoc for a category means that the category is testvoc clean, in both translation directions.
  • Evaluation is taking words and performing an evaluation for post-edition word error rate (WER). The output for those words should be clean.
Week Dates Trimmed coverage Reached Testvoc Evaluation Notes
0 23/04—21/05 45% <abbr> <ij> 500 words Preliminary evaluation. Translate the story in both directions with total coverage and without diagnostics. Get a baseline WER. Work on disambiguation, the morphological ambiguities in the story should be resolved.
1 21/05—27/05 50% <cnjcoo> <cnjadv> <cnjsub> <pr> - Conjunctions and prepositions should be clean. Verbs should be tagged for transitivity.
2 28/05—03/06 53% <adv> -
3 04/06—10/06 59% <num> 200 words Work on disambiguation. Numerals should be clean.
4 11/06—17/06 63% <prn> <det> -
5 18/06—24/06 68% <n> -
6 25/06—01/07 70% <adj> 500 words Midterm evaluation. Work on disambiguation.
7 02/07—08/07 73% - -
8 09/07—15/07 75% - -
9 16/07—22/07 77% - 200 words Work on disambiguation.
10 23/07—29/07 80% <vblex> -
11 30/07—05/08 - - - Closed categories clean.
12 06/08—12/08 - - - Open categories clean.
13 13/08—19/08 - - - Disambiguation and transfer.
14 20/08—24/08 - - - Final evaluation. Tidying up, releasing

Improving coverage - A two week report[edit]

The work on improving the coverage for the slovenian -> bosnian-croatian-montenegrin-serbian language pair should be done 4 hours per day, for two weeks straight.
Day 0 denotes the current state of the language pair, and each subsequent entry will denote the coverage and testvoc reached for that day.

The corpora used for this task can be found here: http://www.statmt.org/europarl/v7/sl-en.tgz

Coverage was calculated using the following script 


echo total;
cat europarl-v7.sl-en.sl | apertium -d ~/Apertium/apertium-sh-sl/ sl-sh-morph | sed 's/\$[^\^]*\^/$\n^/g' | wc -l
# This expression evaluates to 14340199

echo unknown;
cat europarl-v7.sl-en.sl | apertium -d ~/Apertium/apertium-sh-sl/ sl-sh-morph | sed 's/\$[^\^]*\^/$\n^/g' | grep '*' | wc -l

coverage = 1 - unknown / total


Dat Dates Coverage reached Coverage reached (2) Target Notes
0 20-02-2013 87.12% - -
1 01-03-2013 88.39% - [87.56, 88.24]
2 02-03-2013 90.05% - [87.78, 88.80]
3 03-03-2013 91.53% - [88.00, 89.36]
4 04-03-2013 92.36% - [88.22, 89.93]
5 05-03-2013 92.95% - [88.44, 90.49]
6 06-03-2013 93.55% - [88.66, 91.05]
7 07-03-2013 94.11% - [88.88, 91.61]
8 08-03-2013 94.54% - [89.10, 92.17]
9 09-03-2013 94.95% 87.52% [89.32, 92.74]
10 10-03-2013 95.11% 91.46% [89.54, 93.30]
11 11-03.2013 95.26% [89.76, 93.86]
12 13-03-2013 95.41% 93.23% [89.98, 94.42]
13 15-03-2013 95.50% 93.57% [90.20, 94.99]
14 [90.00, 95.00]

The work on improving the coverage for the slovenian -> bosnian-croatian-montenegrin-serbian language pair should be done 2 hours per day, for two weeks straight.
The two tasks do not have to be run in parallel.


Day Dates Testvoc reached Notes
0 26-03-2013 99.76% Regional variants added, some translation mistakes ironed out, a cpl of transfer rules
1 28-03-2013 99.81% Nouns, proper nouns and number categories clean
2 02-04-2013 99.87% Verbs clean
3 03-04-2013 99.90% Adjectives clean sl->bhs
4 04-04-2013 99.92% Adverbs almost clean
5 05-04-2013 99.93% Adverbs bhs->sl left
6 06-04-2013 100% Testvoc clean
7 09-04-2013 100% Strange generation errors cleaned
8 14-04-2013 100% Generation duplicates cleaned
9 15-04-2013 100% 20 transfer rules added
10 16-04-2013 100% 21 transfer rules added
11 17-04-2013 100% particles that testvoc didn't catch clean
12 18-04-2013 100% numerals uncaught by testvoc cleaned
13
14

See also[edit]

Retrieved from "https://wiki.apertium.org/w/index.php?title=Bosnian-Croatian-Montenegrin-Serbian_and_Slovenian&oldid=42451"