User:Ruthenian8/GSOC 2021 progress report - Revision history

Ruthenian8 at 09:17, 18 August 2021

2021-08-18T09:17:51Z

Ruthenian8 at 12:26, 17 August 2021

2021-08-17T12:26:17Z

Ruthenian8 at 19:45, 7 August 2021

2021-08-07T19:45:49Z

Ruthenian8 at 06:17, 13 July 2021

2021-07-13T06:17:10Z

Ruthenian8 at 06:16, 13 July 2021

2021-07-13T06:16:48Z

Ruthenian8 at 06:15, 13 July 2021

2021-07-13T06:15:48Z

Ruthenian8 at 07:06, 23 June 2021

2021-06-23T07:06:57Z

Ruthenian8 at 10:55, 18 June 2021

2021-06-18T10:55:51Z

Ruthenian8: Add table

2021-06-18T10:55:21Z

Add table

Ruthenian8: Created page with "* '''Title''': Morphological analyzer for Bagvalal * '''Proposal''': [https://drive.google.com/file/d/1Y05eQtFP7ioz50z2GlUdvB2Edh4lel6G/view?usp=sharing proposal] * '''Abstrac..."

2021-06-10T09:24:52Z

Created page with "* '''Title''': Morphological analyzer for Bagvalal * '''Proposal''': [https://drive.google.com/file/d/1Y05eQtFP7ioz50z2GlUdvB2Edh4lel6G/view?usp=sharing proposal] * '''Abstrac..."

New page

* '''Title''': Morphological analyzer for Bagvalal
* '''Proposal''': [https://drive.google.com/file/d/1Y05eQtFP7ioz50z2GlUdvB2Edh4lel6G/view?usp=sharing proposal]
* '''Abstract''': updates coming up

* '''GitHub repo''': [https://github.com/ruthenian8/bagvalal bagvalal]
* '''Progress''': updates coming up

@@ Line 2: / Line 2: @@
 * '''Proposal''': [https://drive.google.com/file/d/1Y05eQtFP7ioz50z2GlUdvB2Edh4lel6G/view?usp=sharing proposal]
 * '''Abstract''': Bagvalal is an endangered typologically rare Caucasian language from the Nakh-Daghestanian family. Its conservation and study are constrained by the lack of sufficient NLP-tools that can be used to process field data. <br/>My proposal is to develop an fst-powered morphological analyzer for Bagvalal using all the available grammatical and lexical information. In the future this project can allow Apertium to support morphological analysis for multiple Nakh-Daghestanian languages and develop corresponding language pairs.
-* '''GitHub repo''': [https://github.com/ruthenian8/bagvalal bagvalal]
+* '''GitHub repo (get the code)''': [https://github.com/ruthenian8/bagvalal bagvalal]
+* '''Status''':<br/>
+The analyzer was implemented from scratch using .lexd, .twol and HFST-toolkit.<br/>
+The product currently supports both the Cyrillic scripture and the Caucasiologist transcription and can be used for lemmatizing and glossing Bagvalal corpora<br/>
+It covers all the parts of speech present in the language.<br/>
+Naïve coverage 83%, type coverage 76%.<br/>
+* '''What remains to be done''':<br/>
+- Correct the two-level morphology rules to reduce generation ambiguity (causes test failure).<br/>
+- Manually add morphologically exceptional words to raise the coverage<br/>
 {| class="wikitable"
@@ Line 44: / Line 52: @@
 ! scope="row"| Week 12
 | Running all the tests and debugging
+| Complete
-| In progress
 |}
@@ Line 50: / Line 58: @@
 .08.21
 During the discussion with mentors it was determined that the Bagvalal-specific glosses which are present in the grammar and which have previously been  incorporated in the analyzer should be left without modification. Taking into account that the analyzer is already in a ready state, it was decided to develop additional bilingual plug-ins for Russian and Avar.
-'''Status''': Naive coverage 82%, type coverage 76%.

@@ Line 36: / Line 36: @@
 ! scope="row"| Week 9 & 10
 | Tokenizing the corpora.<br/>Converting the existing annotations to an appropriate format<br/>Creating word-analysis pairs.<br/>Writing documentation.
+| Complete
-| In progress
 |-
 ! scope="row"| Week 11
 | Expelling the false analyses from the model<br/>Testing and debugging.<br/>Finishing the work on the documentation
+| Complete
-| In progress
 |-
 ! scope="row"| Week 12

@@ Line 24: / Line 24: @@
 ! scope="row"| Week 5
 | Adding the missing adjectives and adverbs from the available dictionaries (see the Resources section above).<br/>Testing the analysis results and the model performance.
+| Complete
-| In progress
 |-
 ! scope="row"| Week 6
 | Adding the missing nouns.<br/>Testing the analysis results and the model performance.
+| Complete
-| In progress
 |-
 ! scope="row"| Week 7 & 8
 | Adding the missing verbs, participles, converbs and masdars. <br/>Testing the analysis results and the model performance.
+| Complete
-| In progress
 |-
 ! scope="row"| Week 9 & 10
@@ Line 47: / Line 47: @@
 |}
-'''Development log''': Updates coming up
+'''Development log''':
+.08.21
+During the discussion with mentors it was determined that the Bagvalal-specific glosses which are present in the grammar and which have previously been  incorporated in the analyzer should be left without modification. Taking into account that the analyzer is already in a ready state, it was decided to develop additional bilingual plug-ins for Russian and Avar.
 '''Status''': Naive coverage 82%, type coverage 76%.

← Older revision		Revision as of 06:17, 13 July 2021
Line 48:		Line 48:

	'''Development log''': Updates coming up		'''Development log''': Updates coming up

	'''Status''': Naive coverage 82%, type coverage 76%.		'''Status''': Naive coverage 82%, type coverage 76%.

← Older revision		Revision as of 06:16, 13 July 2021
Line 48:		Line 48:

	'''Development log''': Updates coming up		'''Development log''': Updates coming up
			'''Status''': Naive coverage 82%, type coverage 76%.

@@ Line 16: / Line 16: @@
 ! scope="row"| Week 2
 | Writing documentation and tests.
+| Complete
-| In progress
 |-
 ! scope="row"| Week 3 & 4