Grfro3d/proposal apertium cat-srd and ita-srd - Revision history

Grfro3d: /* Why is it that you are interested in Apertium? */

2017-04-03T14:34:03Z

Why is it that you are interested in Apertium?

Grfro3d: /* Coding Challenge */

2017-04-03T14:32:57Z

Coding Challenge

Grfro3d: /* Coding Challenge */

2017-04-03T14:31:59Z

Coding Challenge

Grfro3d: /* Coding Challenge */

2017-04-03T14:26:26Z

Coding Challenge

Grfro3d: /* Coding Challenge */

2017-04-03T14:26:01Z

Coding Challenge

Grfro3d: /* Coding Challenge */

2017-04-03T14:24:37Z

Coding Challenge

Grfro3d: /* List any non-Summer-of-Code plans you have for the Summer. */

2017-04-02T13:53:45Z

List any non-Summer-of-Code plans you have for the Summer.

Grfro3d: /* Workplan */

2017-04-02T10:41:37Z

Workplan

Grfro3d: /* Apertium Italian to Sardinian (apertium ita-srd) */

2017-04-02T09:48:55Z

Apertium Italian to Sardinian (apertium ita-srd)

Grfro3d: /* Workplan */

2017-04-02T09:36:06Z

Workplan

← Older revision		Revision as of 14:34, 3 April 2017
Line 34:		Line 34:

	Catalan is spoken in the Sardinian city of Alghero by about 33,000 speakers, 8,600 active and 25,000 passive. According to a study of the Generalitat de Catalunya, in Alghero Catalan is understood by 60% of the population, while it is only spoken by 20%. The dominant presence of Catalan in Alghero dates back to the XIV century with the expulsion of the Sardinian populations by the hand of the Aragon Catalans. Later, in Sardinia, Catalan assumed a position of prestige. In 1952, Rafael Sari founded the Center d'Estudis Algueresos for the dissemination and teaching of the Catalan language standards in Sardinia. Among the important people who directed the institute are Rafael Catardi and Antoni Simon Mossa. The "Escola de Alguerés Pascual Scanu" was founded by Josep Sanna and offers courses of Catalan language and literature. Among the most important magazines there is L'Alguer, published only in Catalan.		Catalan is spoken in the Sardinian city of Alghero by about 33,000 speakers, 8,600 active and 25,000 passive. According to a study of the Generalitat de Catalunya, in Alghero Catalan is understood by 60% of the population, while it is only spoken by 20%. The dominant presence of Catalan in Alghero dates back to the XIV century with the expulsion of the Sardinian populations by the hand of the Aragon Catalans. Later, in Sardinia, Catalan assumed a position of prestige. In 1952, Rafael Sari founded the Center d'Estudis Algueresos for the dissemination and teaching of the Catalan language standards in Sardinia. Among the important people who directed the institute are Rafael Catardi and Antoni Simon Mossa. The "Escola de Alguerés Pascual Scanu" was founded by Josep Sanna and offers courses of Catalan language and literature. Among the most important magazines there is L'Alguer, published only in Catalan.

	I'm interested Apertium because is an open-source platform and because it is suitable for similar romance languages. In this case Cat-Srd and Ita-Srd are perfect cases that meet this requirement. Given the influence these languages they have had between themselves, it is easy to note that the Sardinian language still presents many influences of the Catalan language, because of their coexistence during the period of the Catalan-Aragonese occupation Sardinia. All these languages are part of the Sardinian linguistic heritage. This project would give speakers a valuable tool to improve their skills in standard language and to create new bridges between Sardinia and the linguistic and socio-political realities.		I'm interested Apertium because is an open-source platform and because it is suitable for similar romance languages. In this case Cat-Srd and Ita-Srd are perfect cases that meet this requirement. Given the influence these languages they have had between themselves, it is easy to note that the Sardinian language still presents many influences of the Catalan language, because of their coexistence during the period of the Catalan-Aragonese occupation Sardinia. All these languages are part of the Sardinian linguistic heritage. This project would give speakers a valuable tool to improve their skills in standard language and to create new bridges between Sardinia and the linguistic and socio-political realities.

@@ Line 247: / Line 247: @@
 In order to check the current status of the two pairs of languages it was calculated WER/PER.
-'''Apertium cat-srd''': to evaluate the PER was taken from a Catalan Wikipedia text of about 300 words, translated and post-edited . To calculate the WER was used dwdiff[http://wiki.apertium.org/wiki/Evaluation] with a result of 34.8%. (https://apertium.projectjj.com/trac/changeset?old_path=%2Fstaging%2Fapertium-cat-srd&old=77481&new_path=%2Fstaging%2Fapertium-cat-srd&new=77481)
+'''Apertium cat-srd''': to evaluate the PER was taken from a Catalan Wikipedia text of about 300 words, translated and post-edited . To calculate the PER was used dwdiff[http://wiki.apertium.org/wiki/Evaluation] with a result of 34.8%. (https://apertium.projectjj.com/trac/changeset?old_path=%2Fstaging%2Fapertium-cat-srd&old=77481&new_path=%2Fstaging%2Fapertium-cat-srd&new=77481)
 '''Apertium ita-srd''': To evaluate WER was taken a text of 300 words LSC, translated and post-edited. To calculate the WER has been used as apertium-eval-translator [http://wiki.apertium.org/wiki/Evaluation] script with these results:

@@ Line 247: / Line 247: @@
 In order to check the current status of the two pairs of languages it was calculated WER/PER.
-'''Apertium cat-srd''': to evaluate the WER was taken from a Catalan Wikipedia text of about 300 words, translated and post-edited . To calculate the WER was used dwdiff[http://wiki.apertium.org/wiki/Evaluation] with a result of 34.8%. (https://apertium.projectjj.com/trac/changeset?old_path=%2Fstaging%2Fapertium-cat-srd&old=77481&new_path=%2Fstaging%2Fapertium-cat-srd&new=77481)
+'''Apertium cat-srd''': to evaluate the PER was taken from a Catalan Wikipedia text of about 300 words, translated and post-edited . To calculate the WER was used dwdiff[http://wiki.apertium.org/wiki/Evaluation] with a result of 34.8%. (https://apertium.projectjj.com/trac/changeset?old_path=%2Fstaging%2Fapertium-cat-srd&old=77481&new_path=%2Fstaging%2Fapertium-cat-srd&new=77481)
 '''Apertium ita-srd''': To evaluate WER was taken a text of 300 words LSC, translated and post-edited. To calculate the WER has been used as apertium-eval-translator [http://wiki.apertium.org/wiki/Evaluation] script with these results:

@@ Line 251: / Line 251: @@
 '''Apertium ita-srd''': To evaluate WER was taken a text of 300 words LSC, translated and post-edited. To calculate the WER has been used as apertium-eval-translator [http://wiki.apertium.org/wiki/Evaluation] script with these results:
-''Evaluation''Italic text'': Results when removing unknown-word marks (stars) Edit distance: 92 Word error rate (WER): 31.94 % Number of position-independent correct words: 206 Position-independent word error rate (PER): 28.47 % (https://apertium.projectjj.com/trac/changeset/77482/trunk/apertium-srd-ita)
+''Evaluation'': Results when removing unknown-word marks (stars) Edit distance: 92 Word error rate (WER): 31.94 % Number of position-independent correct words: 206 Position-independent word error rate (PER): 28.47 % (https://apertium.projectjj.com/trac/changeset/77482/trunk/apertium-srd-ita)
 Here you can find details about  my participation in GSoC 2016 [https://apertium.projectjj.com/gsoc2016/gfro3d.html].

@@ Line 249: / Line 249: @@
 '''Apertium cat-srd''': to evaluate the WER was taken from a Catalan Wikipedia text of about 300 words, translated and post-edited . To calculate the WER was used dwdiff[http://wiki.apertium.org/wiki/Evaluation] with a result of 34.8%. (https://apertium.projectjj.com/trac/changeset?old_path=%2Fstaging%2Fapertium-cat-srd&old=77481&new_path=%2Fstaging%2Fapertium-cat-srd&new=77481)
-'''Apertium ita-srd''': To evaluate WER was taken a text of 300 words LSC, translated and post-edited. To calculate the WER has been used as apertium-eval-translator [http://wiki.apertium.org/wiki/Evaluation] script with these results.
+'''Apertium ita-srd''': To evaluate WER was taken a text of 300 words LSC, translated and post-edited. To calculate the WER has been used as apertium-eval-translator [http://wiki.apertium.org/wiki/Evaluation] script with these results:
-'''Evaluation''': Results when removing unknown-word marks (stars) Edit distance: 92 Word error rate (WER): 31.94 % Number of position-independent correct words: 206 Position-independent word error rate (PER): 28.47 % (https://apertium.projectjj.com/trac/changeset/77482/trunk/apertium-srd-ita)
+''Evaluation''Italic text'': Results when removing unknown-word marks (stars) Edit distance: 92 Word error rate (WER): 31.94 % Number of position-independent correct words: 206 Position-independent word error rate (PER): 28.47 % (https://apertium.projectjj.com/trac/changeset/77482/trunk/apertium-srd-ita)
 Here you can find details about  my participation in GSoC 2016 [https://apertium.projectjj.com/gsoc2016/gfro3d.html].

@@ Line 214: / Line 214: @@
 | style="text-align:center" |
 '''WER/PER'''
-* 15% >> '''~15%'''
+* '''~15%'''
-* 31,9%  >> '''~20%'''
+* '''~20%'''
 | style="text-align:center" |

@@ Line 54: / Line 54: @@
 The project has already started and currently the bidix is in the Staging section. The Catalan language is definitely the one that has the most resources in the Apertium platform. The cat-srd bidix has 2645 words with a trimmed coverage of 77.7% and a Wer rate of 34.8%: my goal is to bring coverage up to 86,5% and WER to 15%. The work that I think I can make concerns the increased coverage in bidix, increasing the number of terms translated from the Catalan to the Sardinian adding 2000 word/week manually up to 18.000 words to the bidix. I would work on transfer rules (for tenses, NP with possessives, proclitics, enclitics, ordinals, superlatives, etc.) and lexical selection. It would be better to spend more time on apertium cat>srd that in apertium ita>srd (which is easier) in order to have chances of having a new translator ready or almost ready for release at the end of the project.
-=== Apertium Italian to Sardinian (apertium ita-srd) ===
+=== Apertium Italian to Sardinian (apertium-ita-srd) ===
 Last year, thanks to Google Summer of Code program, the first Italian-Sardinian translator was released, apertium ita-srd. The project was a success. All the goals have been achieved: the creation of corpora in LSC; italian monodix: apertium-srd-srd.dix: 51,743 words; apertium-ita-ita.dix: 35,099 words; bidix (apertium-srd-ita.srd-ita.dix) 25,484 words (20,000 in work plan); Coverage: 89.3% e WER: 10.79% [http://wiki.apertium.org/wiki/Sardo_e_italiano/Rapporto_finale]. The pending test page that served the creation of transfer rules 89 and 35 of the lexical selection rules.

@@ Line 76: / Line 76: @@
 |
 * Work on pending test cat>srd
-* Work on pending test cat>srd
+* Work on pending test srd>ita
 | style="text-align:center" |
 | style="text-align:center" |