Maltese and Hebrew/Final report - Revision history

Unhammer: /* Maltese */

2011-08-26T11:13:27Z

Maltese

2011-08-26T11:08:23Z

2011-08-26T11:05:52Z

Bidix

2011-08-26T11:05:13Z

Statistics

2011-08-26T10:57:02Z

Statistics

2011-08-26T10:56:09Z

Statistics

2011-08-26T10:37:52Z

Statistics

2011-08-26T10:37:29Z

doh

2011-08-26T10:36:59Z

wikimarkup

2011-08-26T10:36:29Z

Statistics

@@ Line 9: / Line 9: @@
 We used the very little grammar resources we had<ref>J. Aquilina (1994), Teach Yourself Maltese. [http://books.google.com/books?id=iCdjAAAAMAAJ]</ref><ref>A. Borg (1997),  Maltese (Comparative Grammar). [http://books.google.com/books?id=rsA5jUU_3g4C]</ref> for adding closed-category terms and learning about morphological rules in general.
+Verbs were a challenge; lttoolbox pardefs are not capable of fully handling Maltese verbs, so here we created Python scripts that take a CSV file of verb "stems"[http://en.wikipedia.org/wiki/Semitic_root] and some paradigm information, and output full-form lttoolbox entries.
 We then used Maltese frequency lists generated from the various corpora, and categorized terms slowly using (educated) guesses by context and usage.

@@ Line 111: / Line 111: @@
 * [[User:N0nick/Application|Maltese and Hebrew GSoC Application]].
 * [[Maltese and Hebrew]]: Listings of work and research updated as we go.
-* [[User:N0nick/GSoC_Journal| My GSoC work journal]].
+* [[User:N0nick/GSoC_Journal| My GSoC work journal]] describing my weekly progress.
 * [http://xixona.dlsi.ua.es/~fran/maltese/index.php Maltese morphological analysis]: A live online demo of the Maltese analyser we developed.

@@ Line 35: / Line 35: @@
 The mt→he bidix work was a very 'automatic' task. A lot of the terms we previously added to mt.dix came with gloss so we were able to use it for the translations.
 For the rest, we used all kinds of translation tools and dictionaries, or learned/guestimated the translation by the context in the corpus.
-This took a long time and wasn't fun. But we were able to get a good coverage percentage (in most categories, we got to 100%).
+This took a long time and wasn't fun. But we were able to get a good coverage percentage (in most categories, we got to 99-100%).
 ===Transfer rules===

@@ Line 53: / Line 53: @@
 ; Coverage
-* Maltese Wikipedia (78.25%, std. dev.: 1.23693)
+* Maltese Wikipedia (<b>78.25%</b>, std. dev.: <b>1.23693</b>)
-* Maltese news sites (79.375% , std. dev.: 1.39134)
+* Maltese news sites (<b>79.375%</b> , std. dev.: <b>1.39134</b>)
-* Maltese Scannel corpus (79% std. dev.: 1.9164)
+* Maltese Scannel corpus (<b>79%</b>, std. dev.: <b>1.9164</b>)
 ; Rules
 * <code>apertium.mt-he.mt-he.t1x</code>: <b>16</b> rules.
-; Error rate
 ; Testvoc Summary

@@ Line 63: / Line 63: @@
 ; Error rate
-; Testvoc
+; Testvoc Summary
 <pre>
+on. 24. aug. 11:08:12 +0200 2011
+=======================================================
 POS	Total	Clean	With @	Clean %	With #	Clean %
 prn    	520834	518664	0	100	2170	99.58
@@ Line 83: / Line 85: @@
 abbr   	3	3	0	100	0	100
 rel    	1	1	0	100	0	100
+=======================================================
 </pre>

@@ Line 62: / Line 62: @@
 ; Error rate
+; Testvoc
+<pre>
+POS	Total	Clean	With @	Clean %	With #	Clean %
+prn    	520834	518664	0	100	2170	99.58
+vblex  	5572	5539	0	100	33	99.40
+n      	3770	2533	463	87.71	774	67.18
+adj    	2343	403	38	98.37	1902	17.20
+np     	623	540	83	86.67	0	86.67
+adv    	156	155	0	100	1	99.35
+pr     	123	123	0	100	0	100
+vaux   	92	92	0	100	0	100
+num    	83	83	0	100	0	100
+det    	32	32	0	100	0	100
+cnjcoo 	13	13	0	100	0	100
+cnjsub 	10	10	0	100	0	100
+cnjadv 	4	4	0	100	0	100
+ij     	3	3	0	100	0	100
+abbr   	3	3	0	100	0	100
+rel    	1	1	0	100	0	100
+</pre>
 ==Future work==

@@ Line 71: / Line 71: @@
 ==Thanks==
-Mostly I'd like to thank my mentors [[User:Unhammer|Kevin Unhammer]] and [[Francis Tyers|User:Francis_Tyers]] who have been amazingly helpful and always available. No words can be enough to express my gratitude and how happy I am to have known them and worked with them.
+Mostly I'd like to thank my mentors [[User:Unhammer|Kevin Unhammer]] and [[User:Francis_Tyers|Francis Tyers]] who have been amazingly helpful and always available. No words can be enough to express my gratitude and how happy I am to have known them and worked with them.
 Additionally, as I said I have contacted several people along the way and everyone has been kind and helpful. Many thanks is due to everyone involved, among them:

@@ Line 48: / Line 48: @@
 ; Dictionaries
-* Maltese monodix: <b>3,789</b> lemmata; <b>610,256</b> surface forms.
+* <code>apertium.mt-he.mt.dix</code>: <b>3,789</b> lemmata; <b>610,256</b> surface forms.
-* Hebrew monodix: <b>20,902</b> lemmata; <b>547,272</b> surface forms.
+* <code>apertium.mt-he.he.dix</code>: <b>20,902</b> lemmata; <b>547,272</b> surface forms.
 ; Coverage