Difference between revisions of "Named entity recognition"

From Apertium
Jump to navigation Jump to search
Line 24: Line 24:
   
 
* Babych, B. and Hartley, T. (2003) "[http://www.comp.leeds.ac.uk/bogdan/_data/eamt-eacl2003-babych-hartley.pdf Improving machine translation quality with automatic named entity recognition ]". ''Procs. EACL-EAMT 2003: Improving MT through other language technology tools, Budapest, Hungary, April 2003 ''.
 
* Babych, B. and Hartley, T. (2003) "[http://www.comp.leeds.ac.uk/bogdan/_data/eamt-eacl2003-babych-hartley.pdf Improving machine translation quality with automatic named entity recognition ]". ''Procs. EACL-EAMT 2003: Improving MT through other language technology tools, Budapest, Hungary, April 2003 ''.
  +
  +
  +
[[Category:Development]]

Revision as of 13:20, 8 August 2007

Named entity recognition is about recognising named entities, for example proper nouns, etc. in text. When working with long rules, one of the problems in having them applied can be proper nouns. For example, names, companies, places etc. that aren't in the dictionaries and thus are not analysed. So for example in a sentence like:

  • Die man het John gesien.

would be analysed something like (simplifying slightly):

  • Die<det> man<n><vbhaver> *John gesien<vblex><past>

If we have a rule that says something like:

  • <vbhaver> <noun phrase> <vblex><past> → <vbhaver> <vblex><past> <noun phrase>

This will not apply, because "John" is not detected as anything. As a result the translation will be worse because the word re-ordering has not taken place. So, instead of getting:

  • The man had seen John

We would get:

  • The man had John seen.

Which is less than ideal.

Further reading