Difference between revisions of "English"

From Apertium
Jump to navigation Jump to search
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
'''English''' ([[Wikipedia:English language]]) is a West Germanic languages. It is available in [[Apertium]] as a standalone analyser/generator (apertium-eng) and as a component of several pairs which translate to/from English.
'''English''' ([[Wikipedia:English language]]) is a West Germanic language. It is available in Apertium as a standalone analyser/generator ([[English#Apertium-eng|apertium-eng]]) and as a component of several pairs which translate to/from English.


== Language pairs (incomplete)==
== Language pairs ==
''See also: [[List of language pairs]]''
''See also: [[List of language pairs]]''


Line 29: Line 29:
|}
|}


In [[staging]]:
''See also: [[:Category:English]]''

{|class=wikitable
! width=200 | Pair name !! width=350 | Languages !! width=130 | Last update
|-
| align=center | <code>[[apertium-eng-kaz]]</code> || align=center | English <-> Kazakh || align=center | 14 Apr 2017
|-
|}

In [[nursery]]:

{|class=wikitable
! width=200 | Pair name !! width=350 | Languages !! width=130 | Last update
|-
| align=center | <code>[[apertium-bg-en]]</code> || align=center | Bulgarian <-> English || align=center | 09 Jun 2014
|-
| align=center | <code>[[apertium-en-pt]]</code> || align=center | English <-> Portuguese || align=center | 09 Jun 2014
|-
| align=center | <code>[[apertium-eng-afr]]</code> || align=center | English <-> Afrikaans || align=center | 18 Nov 2016
|-
| align=center | <code>[[apertium-eng-deu]]</code> || align=center | English <-> German || align=center | 13 Apr 2017
|-
| align=center | <code>[[apertium-eng-hin]]</code> || align=center | English <-> Hindi || align=center | 12 Jan 2017
|-
| align=center | <code>[[apertium-fin-eng]]</code> || align=center | Finnish <-> English || align=center | 07 Jun 2015
|-
| align=center | <code>[[apertium-hye-eng]]</code> || align=center | Armenian --> English || align=center | 22 Jan 2013
|-
| align=center | <code>[[apertium-nor-eng]]</code> || align=center | Norwegian <-> English || align=center | 25 Apr 2016
|-
|}

In [[incubator]]:

{|class=wikitable
! width=200 | Pair name !! width=350 | Languages !! width=130 | Last update
|-
| align=center | <code>[[apertium-asm-eng]]</code> || align=center | Assamese <-> English || align=center | 04 Jan 2016
|-
| align=center | <code>[[apertium-bn-en]]</code> || align=center | Bengali <-> English || align=center | 04 Jan 2016
|-
| align=center | <code>[[apertium-ckb-eng]]</code> || align=center | Central Kurdish <-> English || align=center | 13 Oct 2016
|-
| align=center | <code>[[apertium-ell-eng]]</code> || align=center | Modern Greek <-> English || align=center | 29 Sep 2015
|-
| align=center | <code>[[apertium-en-ga]]</code> || align=center | English -?- Irish || align=center | 13 Dec 2016
|-
| align=center | <code>[[apertium-en-it]]</code> || align=center | English <-> Italian || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-en-lt]]</code> || align=center | English -?- Lithuanian || align=center | 07 Dec 2010
|-
| align=center | <code>[[apertium-en-lv]]</code> || align=center | English -?- Latvian || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-en-mt]]</code> || align=center | English -?- Maltese || align=center | 19 Jun 2011
|-
| align=center | <code>[[apertium-en-nl]]</code> || align=center | English <-> Dutch || align=center | 29 Apr 2011
|-
| align=center | <code>[[apertium-en-pl]]</code> || align=center | English <-> Polish || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-en-sq]]</code> || align=center | English --> Albanian || align=center | 31 Aug 2010
|-
| align=center | <code>[[apertium-eng-cat]]</code> || align=center | English <-> Catalan || align=center | 24 Jan 2016
|-
| align=center | <code>[[apertium-eng-ina]]</code> || align=center | English <-> Interlingua || align=center | 13 Jan 2017
|-
| align=center | <code>[[apertium-eng-ita]]</code> || align=center | English <-> Italian || align=center | 08 Jan 2017
|-
| align=center | <code>[[apertium-eng-lvs]]</code> || align=center | English <-> Standard Latvian || align=center | 09 Jun 2014
|-
| align=center | <code>[[apertium-eng-pes]]</code> || align=center | English <-> Iranian Persian || align=center | 11 Aug 2015
|-
| align=center | <code>[[apertium-eng-sco]]</code> || align=center | English <-> Scots || align=center | 01 Apr 2017
|-
| align=center | <code>[[apertium-eng-tel]]</code> || align=center | English <-> Telugu || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-fra-eng]]</code> || align=center | French <-> English || align=center | 24 Mar 2017
|-
| align=center | <code>[[apertium-gle-eng]]</code> || align=center | Irish <-> English || align=center | 01 Feb 2016
|-
| align=center | <code>[[apertium-ht-en]]</code> || align=center | Haitian Creole --> English || align=center | 04 Jan 2016
|-
| align=center | <code>[[apertium-hun-eng]]</code> || align=center | Hungarian --> English || align=center | 19 Jan 2016
|-
| align=center | <code>[[apertium-kmr-eng]]</code> || align=center | Kmer ? <-> English || align=center | 06 Mar 2017
|-
| align=center | <code>[[apertium-ky-en]]</code> || align=center | Kyrgyz -?- English || align=center | 29 Jun 2011
|-
| align=center | <code>[[apertium-la-en]]</code> || align=center | Latin -?- English || align=center | 01 Dec 2011
|-
| align=center | <code>[[apertium-lat-eng]]</code> || align=center | Latin <-> English || align=center | 11 Jan 2017
|-
| align=center | <code>[[apertium-mal-eng]]</code> || align=center | Malayalam <-> English || align=center | 04 Jan 2016
|-
| align=center | <code>[[apertium-mar-eng]]</code> || align=center | Marathi --> English || align=center | 12 May 2013
|-
| align=center | <code>[[apertium-mfe-en]]</code> || align=center | Morisyen --> English || align=center | 19 Jun 2010
|-
| align=center | <code>[[apertium-ne-en]]</code> || align=center | Nepali <-> English || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-pes-eng]]</code> || align=center | Iranian Persian <-> English || align=center | 11 Mar 2017
|-
| align=center | <code>[[apertium-rus-eng]]</code> || align=center | Russian -?- English || align=center | 18 May 2014
|-
| align=center | <code>[[apertium-sah-eng]]</code> || align=center | Yakut -?- English || align=center | 18 Mar 2015
|-
| align=center | <code>[[apertium-si-en]]</code> || align=center | Sinhala <-> English || align=center | 26 Jun 2015
|-
| align=center | <code>[[apertium-sjo-eng]]</code> || align=center | Xibe --> English || align=center | 09 Nov 2014
|-
| align=center | <code>[[apertium-swa-eng]]</code> || align=center | Swahili -?- English || align=center | 17 Dec 2016
|-
| align=center | <code>[[apertium-swe-eng]]</code> || align=center | Swedish <-> English || align=center | 17 Dec 2016
|-
| align=center | <code>[[apertium-tha-eng]]</code> || align=center | Thai <-> English || align=center | 03 Dec 2016
|-
| align=center | <code>[[apertium-tr-en]]</code> || align=center | Turkish <-- English || align=center | 04 Aug 2011
|-
| align=center | <code>[[apertium-vi-en]]</code> || align=center | Vietnamese --> English || align=center | 24 Oct 2010
|-
|}

== Apertium-eng ==

===Current status===

''Last update: 28 Aug 2017''

'''Dix entries:''' 54,453

'''Dix paradigms:''' 377

'''Coverage:''' 93.55% (Wikipedia)

===Dictionary guidelines===

The current English dictionary is quite big (nearly 55,000 entries), so tidiness is essential to ensure future development:

* Keep entries sorted alphabetically.
* Keep entries grouped by type and tags (do not mix different types of proper nouns together).
* Check the file with apertium-dixtools (to update the number of entries and remove duplicates).

====Spelling variants====

The standard spelling variant in Apertium is British English. American English spelling entries are officially supported using <code>v="eng"</code> in the original British entry and <code>v="eng_US"</code> in the American entry, which should be a subform of the first one.

=== Tagger ===

Apertium-eng currently uses a tagger trained in a supervised manner using a hand-tagged corpus and a perceptron. The corpus can be found [https://svn.code.sf.net/p/apertium/svn/languages/apertium-eng/texts/consensus here], and should be modified after any tag change in the monolingual dictionary to make sure it matches the current status of the language module. The MTX file for English has no rules defined for now, but it should improve disambiguation after some restrictions are added.

The tagger can be trained with the perceptron using the following command (see [[Perceptron tagger]]):

<pre>
$ apertium-tagger -xs 10 eng.prob eng.tagged eng.untagged apertium-eng.eng.mtx
</pre>

''Note: in the example above, "10" is the number of iterations, "eng.tagged" is the hand-tagged corpus and "eng.untagged" is the corpus tagged by apertium-tagger.''

Before making changes to the hand-tagged corpus, make sure you have read the [[Tagging_guidelines_for_English|tagging guidelines]]. A good corpus is the key to a good tagger!

=== Constraint Grammar ===

Apertium-eng currently has 38 CG rules. There is a lot of room for disambiguation improvement using CG, but ideally some rules should be moved to the tagger MTX.

===Future work===

* Improve support of British/American ortography variants.


''For further documentation about English in Apertium, check: [[:Category:English]]''


[[Category:Languages]]
[[Category:Languages]]
[[Category:West Germanic languages]]
[[Category:West Germanic languages]]
[[Category:Documentation in English]]

Latest revision as of 22:00, 1 May 2018

English (Wikipedia:English language) is a West Germanic language. It is available in Apertium as a standalone analyser/generator (apertium-eng) and as a component of several pairs which translate to/from English.

Language pairs[edit]

See also: List of language pairs

In trunk:

Pair name Languages Last update
apertium-cy-en Welsh <-> English 13 Dec 2015
apertium-en-ca English <-> Catalan 28 Mar 2016
apertium-en-es English <-> Spanish 11 Apr 2017
apertium-en-gl English <-> Galician 15 Jul 2016
apertium-eo-en Esperanto <-> English 13 Dec 2015
apertium-eu-en Basque --> English 13 Dec 2015
apertium-hbs-eng Serbo-Croatian <-> English 15 Oct 2014
apertium-isl-eng Icelandic --> English 02 Mar 2016
apertium-mk-en Macedonian --> English 12 Oct 2014

In staging:

Pair name Languages Last update
apertium-eng-kaz English <-> Kazakh 14 Apr 2017

In nursery:

Pair name Languages Last update
apertium-bg-en Bulgarian <-> English 09 Jun 2014
apertium-en-pt English <-> Portuguese 09 Jun 2014
apertium-eng-afr English <-> Afrikaans 18 Nov 2016
apertium-eng-deu English <-> German 13 Apr 2017
apertium-eng-hin English <-> Hindi 12 Jan 2017
apertium-fin-eng Finnish <-> English 07 Jun 2015
apertium-hye-eng Armenian --> English 22 Jan 2013
apertium-nor-eng Norwegian <-> English 25 Apr 2016

In incubator:

Pair name Languages Last update
apertium-asm-eng Assamese <-> English 04 Jan 2016
apertium-bn-en Bengali <-> English 04 Jan 2016
apertium-ckb-eng Central Kurdish <-> English 13 Oct 2016
apertium-ell-eng Modern Greek <-> English 29 Sep 2015
apertium-en-ga English -?- Irish 13 Dec 2016
apertium-en-it English <-> Italian 26 Jun 2015
apertium-en-lt English -?- Lithuanian 07 Dec 2010
apertium-en-lv English -?- Latvian 26 Jun 2015
apertium-en-mt English -?- Maltese 19 Jun 2011
apertium-en-nl English <-> Dutch 29 Apr 2011
apertium-en-pl English <-> Polish 26 Jun 2015
apertium-en-sq English --> Albanian 31 Aug 2010
apertium-eng-cat English <-> Catalan 24 Jan 2016
apertium-eng-ina English <-> Interlingua 13 Jan 2017
apertium-eng-ita English <-> Italian 08 Jan 2017
apertium-eng-lvs English <-> Standard Latvian 09 Jun 2014
apertium-eng-pes English <-> Iranian Persian 11 Aug 2015
apertium-eng-sco English <-> Scots 01 Apr 2017
apertium-eng-tel English <-> Telugu 26 Jun 2015
apertium-fra-eng French <-> English 24 Mar 2017
apertium-gle-eng Irish <-> English 01 Feb 2016
apertium-ht-en Haitian Creole --> English 04 Jan 2016
apertium-hun-eng Hungarian --> English 19 Jan 2016
apertium-kmr-eng Kmer ? <-> English 06 Mar 2017
apertium-ky-en Kyrgyz -?- English 29 Jun 2011
apertium-la-en Latin -?- English 01 Dec 2011
apertium-lat-eng Latin <-> English 11 Jan 2017
apertium-mal-eng Malayalam <-> English 04 Jan 2016
apertium-mar-eng Marathi --> English 12 May 2013
apertium-mfe-en Morisyen --> English 19 Jun 2010
apertium-ne-en Nepali <-> English 26 Jun 2015
apertium-pes-eng Iranian Persian <-> English 11 Mar 2017
apertium-rus-eng Russian -?- English 18 May 2014
apertium-sah-eng Yakut -?- English 18 Mar 2015
apertium-si-en Sinhala <-> English 26 Jun 2015
apertium-sjo-eng Xibe --> English 09 Nov 2014
apertium-swa-eng Swahili -?- English 17 Dec 2016
apertium-swe-eng Swedish <-> English 17 Dec 2016
apertium-tha-eng Thai <-> English 03 Dec 2016
apertium-tr-en Turkish <-- English 04 Aug 2011
apertium-vi-en Vietnamese --> English 24 Oct 2010

Apertium-eng[edit]

Current status[edit]

Last update: 28 Aug 2017

Dix entries: 54,453

Dix paradigms: 377

Coverage: 93.55% (Wikipedia)

Dictionary guidelines[edit]

The current English dictionary is quite big (nearly 55,000 entries), so tidiness is essential to ensure future development:

  • Keep entries sorted alphabetically.
  • Keep entries grouped by type and tags (do not mix different types of proper nouns together).
  • Check the file with apertium-dixtools (to update the number of entries and remove duplicates).

Spelling variants[edit]

The standard spelling variant in Apertium is British English. American English spelling entries are officially supported using v="eng" in the original British entry and v="eng_US" in the American entry, which should be a subform of the first one.

Tagger[edit]

Apertium-eng currently uses a tagger trained in a supervised manner using a hand-tagged corpus and a perceptron. The corpus can be found here, and should be modified after any tag change in the monolingual dictionary to make sure it matches the current status of the language module. The MTX file for English has no rules defined for now, but it should improve disambiguation after some restrictions are added.

The tagger can be trained with the perceptron using the following command (see Perceptron tagger): 

$ apertium-tagger -xs 10 eng.prob eng.tagged eng.untagged apertium-eng.eng.mtx

Note: in the example above, "10" is the number of iterations, "eng.tagged" is the hand-tagged corpus and "eng.untagged" is the corpus tagged by apertium-tagger.

Before making changes to the hand-tagged corpus, make sure you have read the tagging guidelines. A good corpus is the key to a good tagger!

Constraint Grammar[edit]

Apertium-eng currently has 38 CG rules. There is a lot of room for disambiguation improvement using CG, but ideally some rules should be moved to the tagger MTX.

Future work[edit]

  • Improve support of British/American ortography variants.


For further documentation about English in Apertium, check: Category:English

Retrieved from "https://wiki.apertium.org/w/index.php?title=English&oldid=66834"