Hectoralos/GSOC 2020 work plan control - Revision history

Hectoralos at 06:14, 27 August 2020

2020-08-27T06:14:21Z

Hectoralos at 20:56, 26 August 2020

2020-08-26T20:56:15Z

Hectoralos at 16:39, 26 August 2020

2020-08-26T16:39:51Z

Hectoralos at 18:14, 25 August 2020

2020-08-25T18:14:43Z

Hectoralos at 21:16, 23 August 2020

2020-08-23T21:16:18Z

Hectoralos at 17:00, 16 August 2020

2020-08-16T17:00:05Z

Hectoralos at 11:26, 16 August 2020

2020-08-16T11:26:04Z

Hectoralos at 08:00, 12 August 2020

2020-08-12T08:00:53Z

Hectoralos at 15:47, 9 August 2020

2020-08-09T15:47:47Z

Hectoralos at 15:42, 9 August 2020

2020-08-09T15:42:14Z

@@ Line 306: / Line 306: @@
 Number of unknown words which were free rides: 108<br>
 Percentage of unknown words that were free rides: 40.15 %<br><br>
-There is a noticeable difference in the results in the Wikipedia texts (WER: 13.4%) and the manual (WER: 19.0%). It seems significant that the author of the manual is from the Aosta Valley and has constructions that are less similar to the French ones (which does not mean at all that his Arpitan is worse than any other variety, maybe the opposite could be sustained).
+There is a noticeable difference in the results in the Wikipedia texts (WER: 13.4%) and the manual (WER: 19.0%). It seems significant that the author of the manual is from the Aosta Valley and uses constructions that are less similar to the French ones (which does not mean at all that his Arpitan is worse than any other variety, maybe the opposite could be sustained).
 </ref>
 | style="text-align:center" | fra > frp<br>100%<br>frp > fra<br>100%

@@ Line 240: / Line 240: @@
 | style="text-align:center" | fra > frp '''<20%'''<br>frp > fra '''<25%'''
 | style="text-align:center" | Testvoc: n
-| style="text-align:center" |
+| style="text-align:center" | 22,667
-| style="text-align:center" |
+| style="text-align:center" | 24,775<br>fra > frp<br>20,423<br>frp > fra<br>21,964
-| style="text-align:center" |
+| style="text-align:center" | fra > frp<br>95.8<br>frp > fra<br>96.0
-| style="text-align:center" |
+| style="text-align:center" | fra > frp<br>92.8<br>frp > fra<br>81.5
 | style="text-align:center" | fra > frp<br>5.7<ref>
 The test was conducted using four randomly selected texts (total: ~1600 words): three "good" Wikipedia articles ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_ChevalAuTogo.fra.txt Cheval au Togo], [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_ElisabethDeBaviere.fra.txt Élisabeth de Bavière] and [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_Nyctalope.fra.txt Nyctalope]) and the most outstanding article on lemonde.fr at the time of the test ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_LM_CrisesDiplomatiques.fra.txt Pour Emmanuel Macron, un été de crises diplomatiques]).<br>
@@ Line 308: / Line 308: @@
 There is a noticeable difference in the results in the Wikipedia texts (WER: 13.4%) and the manual (WER: 19.0%). It seems significant that the author of the manual is from the Aosta Valley and has constructions that are less similar to the French ones (which does not mean at all that his Arpitan is worse than any other variety, maybe the opposite could be sustained).
 </ref>
-| style="text-align:center" |
+| style="text-align:center" | fra > frp<br>100%<br>frp > fra<br>100%
 |}

@@ Line 275: / Line 275: @@
 Number of unknown words which were free rides: 20<br>
 Percentage of unknown words that were free rides: 32.79 %
+</ref><br>frp > fra<br>15.5<ref>
+The test was conducted using randomly selected texts (total: ~1700 words): 30 (!) randomly selected Wikipedia articles ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200826_WP.fra.txt 200826_WP.fra.txt] -- there are no labelled "good articles" in the Arpitan Wikipedia and most of them have 1-3 sentences), adding up 1063 words, and the first three pages of the "manual" of the site arpitan.eu ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200826_Manuel.frp.txt 200826_Manuel.frp.txt]), 636 words.<br>
+<br>
+Test file: [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200826_WP_frp-fra.ini.txt '200826_WP_frp-fra.ini.txt']<br>
+Reference file [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200826_WP_frp-fra.fin.txt '200826_WP_frp-fra.fin.txt']<br>
+<br>
+Statistics about input files<br>
+-------------------------------------------------------
+Number of words in reference: 1699<br>
+Number of words in test: 1703<br>
+Number of unknown words (marked with a star) in test: 269<br>
+Percentage of unknown words: 15.80 %<br>
+<br>
+Results when removing unknown-word marks (stars)<br>
+-------------------------------------------------------
+Edit distance: 264<br>
+Word error rate (WER): 15.54 %<br>
+Number of position-independent correct words: 1480<br>
+Position-independent word error rate (PER): 13.13 %<br>
+<br>
+Results when unknown-word marks (stars) are not removed<br>
+-------------------------------------------------------
+Edit distance: 372<br>
+Word Error Rate (WER): 21.90 %<br>
+Number of position-independent correct words: 1373<br>
+Position-independent word error rate (PER): 19.42 %<br>
+<br>
+Statistics about the translation of unknown words<br>
+-------------------------------------------------------
+Number of unknown words which were free rides: 108<br>
+Percentage of unknown words that were free rides: 40.15 %<br><br>
+There is a noticeable difference in the results in the Wikipedia texts (WER: 13.4%) and the manual (WER: 19.0%). It seems significant that the author of the manual is from the Aosta Valley and has constructions that are less similar to the French ones (which does not mean at all that his Arpitan is worse than any other variety, maybe the opposite could be sustained).
 </ref>
 | style="text-align:center" |

@@ Line 132: / Line 132: @@
 | style="text-align:center" | fra > frp<br>5.5<ref>
 The test was conducted using three randomly selected texts (total: ~1000 words): two "good" Wikipedia articles ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_WP_MyLife.fra.txt In My Life] and [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_WP_Niger.fra.txt Niger (cheval)]) and the most outstanding article on lemonde.fr at the time of the test ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_LM_Pompili.fra.txt Barbara Pompili : « C’est le bon moment pour gagner la bataille écologique »]). The results are surprisingly good, even though the translator still needs work. The reasons for this may be several: the articles may have been easy; the revision (by a native speaker) may have been too acquiescent; the close proximity of the languages and the great variety of Arpitan may make it more difficult to consider the translator's choice wrong than in more distant languages with well-established standards; and, of course, it is a huge advantage to have been able to use an extensive electronic dictionary and to have the help of two great language experts who are very committed to the project.<br>
+<br>
 Test file: [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_fra-frp.ini.txt '200727_fra-frp.ini.txt']<br>
 Reference file [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_fra-frp.fin.txt '200727_fra-frp.fin.txt']<br>
@@ Line 162: / Line 163: @@
 </ref><br>
 frp > fra<br>10.7<ref>No he trobat (encara) la manera de fer una prova realment aleatòria de textos. No conec cap revista electrònica en arpità a la xarxa i la Viquipèdia arpitana està escrita amb diferents normes i, a més, acostuma a tenir articles que són simples plantilles. He agafat tres articles ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_WP_France.frp.txt France], [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_WP_Rimbaud.frp.txt Rimbaud] i [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_WP_Toquio.frp.txt Toquio], ~ 1000 paraules), sobre els quals no havia treballat abans, i he obtingut uns resultats massa bons. És inimaginable que això passi en textos reals, especialment quan s'escriu amb una acceptació molt àmplia de les normes per a adaptar-les a la parla local (el que en diuen "grafia estreta").<br>
+<br>
 Test file: [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_frp-fra.ini.txt '200727_frp-fra.ini.txt']<br>
 Reference file [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200727_frp-fra.fin.txt '200727_frp-fra.fin.txt']<br>
@@ Line 242: / Line 244: @@
 | style="text-align:center" |
 | style="text-align:center" |
-| style="text-align:center" |
+| style="text-align:center" | fra > frp<br>5.7<ref>
+The test was conducted using four randomly selected texts (total: ~1600 words): three "good" Wikipedia articles ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_ChevalAuTogo.fra.txt Cheval au Togo], [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_ElisabethDeBaviere.fra.txt Élisabeth de Bavière] and [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_WP_Nyctalope.fra.txt Nyctalope]) and the most outstanding article on lemonde.fr at the time of the test ([https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_LM_CrisesDiplomatiques.fra.txt Pour Emmanuel Macron, un été de crises diplomatiques]).<br>
+<br>
+Test file: [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_fra-frp.ini.txt '200820_fra-frp.ini.txt']<br>
+Reference file [https://raw.githubusercontent.com/apertium/apertium-fra-frp/master/tests/200820_fra-frp.fin.txt '200820_fra-frp.fin.txt']<br>
+<br>
+Statistics about input files<br>
+-------------------------------------------------------
+Number of words in reference: 1635<br>
+Number of words in test: 1629<br>
+Number of unknown words (marked with a star) in test: 61<br>
+Percentage of unknown words: 3.74 %<br>
+<br>
+Results when removing unknown-word marks (stars)<br>
+-------------------------------------------------------
+Edit distance: 93<br>
+Word error rate (WER): 5.69 %<br>
+Number of position-independent correct words: 1548<br>
+Position-independent word error rate (PER): 5.32 %<br>
+<br>
+Results when unknown-word marks (stars) are not removed<br>
+-------------------------------------------------------
+Edit distance: 113<br>
+Word Error Rate (WER): 6.91 %<br>
+Number of position-independent correct words: 1528<br>
+Position-independent word error rate (PER): 6.54 %<br>
+<br>
+Statistics about the translation of unknown words<br>
+-------------------------------------------------------
+Number of unknown words which were free rides: 20<br>
+Percentage of unknown words that were free rides: 32.79 %
+</ref>
 | style="text-align:center" |
 |}

@@ Line 225: / Line 225: @@
 | style="text-align:center" |
 | style="text-align:center" | Testvoc: adj, adv
+| style="text-align:center" | 22,407
+| style="text-align:center" | 24,459<br>fra > frp<br>20,142<br>frp > fra<br>21,694
+| style="text-align:center" | fra > frp<br>95.7<br>frp > fra<br>96.0
+| style="text-align:center" | fra > frp<br>92.7<br>frp > fra<br>81.4
 | style="text-align:center" |
-| style="text-align:center" |
+| style="text-align:center" | verbs:<br>fra > frp<br>99,99%<br>frp > fra<br>100%
-| style="text-align:center" |
-| style="text-align:center" |
-| style="text-align:center" |
-| style="text-align:center" |
 |-
 ! 13

@@ Line 217: / Line 217: @@
 | style="text-align:center" | fra > frp<br>92.6<br>frp > fra<br>81.3
 | style="text-align:center" |
-| style="text-align:center" |
+| style="text-align:center" | non-verbs:<br>fra > frp<br>100%<br>frp > fra<br>100%
 |-
 ! 12

← Older revision		Revision as of 08:00, 12 August 2020
Line 251:		Line 251:

	=== Notes ===		=== Notes ===

			[[Category:French and Arpitan]]

@@ Line 121: / Line 121: @@
 |-
 ! 9
-| style="text-align:left"   | '''27 July -<br>3 August'''
+| style="text-align:left"   | '''27 July -<br>2 August'''
 | style="text-align:center" | '''~10,500'''
 | style="text-align:center" | fra-frp '''~89%'''<br>frp > fra '''~92%'''
@@ Line 194: / Line 194: @@
 |-
 ! 10
-| style="text-align:left"   | 4 August -<br>10 August
+| style="text-align:left"   | 3 August -<br>9 August
 | style="text-align:center" | ~11,500
 | style="text-align:center" |
@@ Line 207: / Line 207: @@
 |-
 ! 11
-| style="text-align:left"   | 11 August -<br>17 August
+| style="text-align:left"   | 10 August -<br>16 August
 | style="text-align:center" | ~12,500
 | style="text-align:center" |
@@ Line 220: / Line 220: @@
 |-
 ! 12
-| style="text-align:left"   | 18 August -<br>23 August
+| style="text-align:left"   | 17 August -<br>23 August
 | style="text-align:center" | ~12,750
 | style="text-align:center" |