User talk:Rlopez/Application - Revision history

Rlopez: /* Week Plan */

2014-03-21T13:35:27Z

Week Plan

Rlopez: /* Week Plan */

2014-03-21T13:31:22Z

Week Plan

Rlopez: /* Week Plan */

2014-03-21T13:27:23Z

Week Plan

Rlopez: /* Week Plan */

2014-03-21T12:57:45Z

Week Plan

Rlopez: /* Week Plan */

2014-03-21T12:53:55Z

Week Plan

Rlopez: /* Week Plan */

2014-03-21T12:52:39Z

Week Plan

Rlopez at 12:34, 21 March 2014

2014-03-21T12:34:24Z

Rlopez: /* Description */

2014-03-21T06:15:25Z

Description

Rlopez at 06:13, 21 March 2014

2014-03-21T06:13:49Z

Rlopez at 05:47, 21 March 2014

2014-03-21T05:47:44Z

@@ Line 199: / Line 199: @@
 | Week 7
 |
-* Study of the specifications of the news languages.
+* Study the specifications of the news languages.
 * Collect data for the new languages.

@@ Line 171: / Line 171: @@
 | Week 2
 |
-- Implementations of the 10 sub-modules for English and Spanish (Part 1).
+* Implementations of the 10 sub-modules for English and Spanish (Part 1).
 |-
 | Week 3
@@ Line 182: / Line 182: @@
 * Make tests, check for bugs, and documentation.
 |-
-| '''First Deliverable: Normalizer Module of non-standard text for English and Spanish'''
+| '''First Deliverable:'''
+| '''Normalizer Module of non-standard text for English and Spanish'''
 |-
 |Week  5
@@ Line 206: / Line 207: @@
 * Make tests, check for bugs, and documentation.
 |-
-| '''Second Deliverable: Normalizer Module of non-standard text for English, Spanish and Portuguese'''
+| '''Second Deliverable:'''
+| '''Normalizer Module of non-standard text for English, Spanish and Portuguese'''
 |-
 | Week 9
@@ Line 228: / Line 230: @@
 |-
-| '''Third Deliverable: A full implementation of the project'''
+| '''Third Deliverable:'''
+| '''A full implementation of the project'''
 |-
 |}

@@ Line 165: / Line 165: @@
 |-
 | Week 1
-| A
+|
+* Collect data for English language (slangs, tweets for the Trigram Language Model, etc.).
+* Collect data for Spanish language (slangs, tweets for the Trigram Language Model, etc.).
 |-
 | Week 2
-| A
+|
+- Implementations of the 10 sub-modules for English and Spanish (Part 1).
 |-
 | Week 3
-| A
+|
+* Implementations of the 10 sub-modules for English and Spanish (Part 2).
+* Compare the new Apertium’s results with other machines translations systems for improvement (English and Spanish).
 |-
 | Week 4
@@ Line 177: / Line 182: @@
 * Make tests, check for bugs, and documentation.
 |-
-| '''First Deliverable'''
+| '''First Deliverable: Normalizer Module of non-standard text for English and Spanish'''
 |-
 |Week  5
-| A
+|
+* Collect data for Portuguese language (slangs, tweets for the Trigram Language Model, etc.).
+* Implementations of the 10 sub-modules for Portuguese (Part 1).
 |-
 |Week  6
-| A
+|
+* Implementations of the 10 sub-modules for Portuguese (Part 2).
+* Compare the new Apertium’s results with other machines translations systems for improvement (Portuguese).
 |-
 | Week 7
-| A
+|
+* Study of the specifications of the news languages.
+* Collect data for the new languages.
 |-
 | Week 8
@@ Line 192: / Line 206: @@
 * Make tests, check for bugs, and documentation.
 |-
-| '''Second Deliverable:'''
+| '''Second Deliverable: Normalizer Module of non-standard text for English, Spanish and Portuguese'''
 |-
 | Week 9
-| A
+|
+* Implementations of the sub-modules for the new languages (Part 1).
 |-
 | Week 10
-| A
+|
+* Implementations of the sub-modules for the new languages (Part 2).
 |-
 | Week 11
-| A
+|
+* Compare the new Apertium’s results with other machines translations systems for improvement (new languages).
+* Make tests and check for bugs.
 |-
 | Week 12

@@ Line 174: / Line 174: @@
 |-
 | Week 4
-| A
+|
+* Make tests, check for bugs, and documentation.
 |-
 | '''First Deliverable'''
@@ Line 188: / Line 189: @@
 |-
 | Week 8
-| A
+|
+* Make tests, check for bugs, and documentation.
 |-
 | '''Second Deliverable:'''

@@ Line 202: / Line 202: @@
 |-
 | Week 12
+|
-| * Final documentation.
+* Final documentation.
 * Writing of the paper about the work.

@@ Line 157: / Line 157: @@
 ==== Week Plan ====
+Initially, I will work with 3 languages very familiar for me: English, Spanish and Portuguese. In the third month, I plan to work with at least two new languages, according to the mentor’s suggestions and the complexity of the language’s specifications.
 {| class="wikitable" border="1"
@@ Line 201: / Line 202: @@
 |-
 | Week 12
+| * Final documentation.
-| A
+* Writing of the paper about the work.
 |-
-| '''Third Deliverable: A full implementation of the project.'''
+| '''Third Deliverable: A full implementation of the project'''
 |-
 |}

@@ Line 189: / Line 189: @@
 | A
 |-
-| '''Second Deliverable'''
+| '''Second Deliverable:'''
 |-
 | Week 9
@@ Line 203: / Line 203: @@
 | A
 |-
+| '''Third Deliverable: A full implementation of the project.'''
-| '''Finalitation'''
+|-
 |}

← Older revision		Revision as of 06:15, 21 March 2014
Line 96:		Line 96:

	'''7. Abbreviation Mapping'''		'''7. Abbreviation Mapping'''

	Nowadays, abbreviations and Internet slang are very commons. For example:		Nowadays, abbreviations and Internet slang are very commons. For example:

@@ Line 118: / Line 118: @@
 '''9. Punctuation Correction'''
+In this sub-module, basically we can solve two problems: the hyphen replacement and the non-standard capitalisation. For example:
+<pre>
+re-integrate --> reintegrate
+i know her --> I know her
+</pre>
+For the first example, we verify if the word contains a hyphen and remove it. For the second example, we can use the Trigram Language Model to verify if the letter 'i' refers to the pronoun or not.
 '''10. Format Data'''

@@ Line 96: / Line 96: @@
 '''7. Abbreviation Mapping'''
+Nowadays, abbreviations and Internet slang are very commons. For example:
 <pre>
@@ Line 101: / Line 102: @@
 tgthr --> together
 </pre>
+To solve that, we can use a dictionary like [http://en.wiktionary.org/wiki/Appendix:English_internet_slang  this] or other bigger and map them to their meanings.
 '''8. Token Splitter'''
@@ Line 111: / Line 114: @@
 </pre>
-To correct that, we can split the token in two tokens and verify iteratively if the two tokens are contained in a dictionary (correct words). Another alternative can be the proposal of Sproat et al..<ref>Sproat, R., Black, A. W., Chen, S., Kumar, S., Ostendorf, M., & Richards, C. (2001). Normalitation of non-standard words. Computer Speech & Language, 15(3), 287-333.</ref>.
+To correct that, we can split the token in two tokens and verify iteratively if the two tokens are contained in a dictionary (correct words). Another alternative can be the proposal of Sproat et al.<ref>Sproat, R., Black, A. W., Chen, S., Kumar, S., Ostendorf, M., & Richards, C. (2001). Normalitation of non-standard words. Computer Speech & Language, 15(3), 287-333.</ref>.
 '''9. Punctuation Correction'''