View source for Languages

{{TOCD}}
:''If you are looking for the category, click [[:Category:Languages|here]]''

'''Languages''' is a module of the [[SVN]] where monolingual language data lives. Monolingual language data in Apertium is slowly being moved to this new repository scheme.  (Originally, all monolingual language data was found in language pairs, meaning that there was a lot of duplication.)  If you feel something is missing, please feel free to [[contact|contact us]].

New monolingual packages should be developed in incubator until they're minimally useful, at which point they can go in languages.  There is no fixed criterion for what constitutes a minimally-useful language package; generally, however, a language package should have over 60% coverage on a variety of corpora and should probably have at least 2500 stems to be considered minimally useful.

The languages module can be found in svn at [https://svn.code.sf.net/p/apertium/svn/languages https://svn.code.sf.net/p/apertium/svn/languages] .

==Contents==

=== Languages by coverage ===

{|class="wikitable sortable"
! Module !! Language !! Entries !! Coverage
|-
| apertium-bak|| [[Bashkir]] ||align="right"| {{#lst:apertium-bak/stats|stems}} ||align="center"| [[Apertium-bak#Current_State|~{{:Apertium-bak/stats/average}}%]]
|-
| apertium-ben|| [[Bengali]] ||align="right"| {{#lst:apertium-ben/stats|stems}} ||align="center"| - 
|-
| apertium-bul|| Bulgarian ||align="right"| {{#lst:apertium-bul/stats|stems}}  ||align="center"| - 
|-
| apertium-ces|| [[Czech]] ||align="right"| {{#lst:apertium-ces/stats|stems}} ||align="center"| [[Apertium-ces#Current_State|~{{:Apertium-ces/stats/average}}%]]
|-
| apertium-chv|| [[Chuvash]] ||align="right"| {{#lst:apertium-chv/stats|stems}} ||align="center"| [[Apertium-chv#Current_State|~{{:Apertium-chv/stats/average}}%]]
|-
| apertium-dan|| Danish ||align="right"| {{#lst:apertium-dan/stats|stems}} ||align="center"| - 
|-
| apertium-ell|| Greek ||align="right"| {{#lst:apertium-ell/stats|stems}} ||align="center"| - 
|-
| apertium-fao|| Faroese ||align="right"| - ||align="center"| - 
|-
| apertium-fin|| Finnish ||align="right"| {{#lst:apertium-fin/stats|stems}} ||align="center"| - 
|-
| apertium-gla|| Scottish Gaelic ||align="right"| - ||align="center"| - 
|-
| apertium-hbs|| Serbo-Croatian ||align="right"| {{#lst:apertium-hbs/stats|stems}}  ||align="center"| - 
|-
| apertium-hin|| [[Hindi]] ||align="right"| {{#lst:apertium-hin/stats|stems}} ||align="center"| - 
|-
| apertium-hye|| Armenian ||align="right"| {{#lst:apertium-hye/stats|stems}} ||align="center"| - 
|-
| apertium-isl|| Icelandic ||align="right"| - ||align="center"| - 
|-
| apertium-kaz|| [[Kazakh]] ||align="right"| {{#lst:apertium-kaz/stats|stems}} ||align="center"| [[Apertium-kaz#Current_State|~{{:Apertium-kaz/stats/average}}%]]
|-
| apertium-kir|| [[Kyrgyz]] ||align="right"| {{#lst:apertium-kir/stats|stems}} ||align="center"| [[Apertium-kir#Current_State|~{{:Apertium-kir/stats/average}}%]]
|-
| apertium-kum|| [[Kumyk]] ||align="right"|  {{#lst:apertium-kum/stats|stems}} ||align="center"| [[Apertium-kum#Current_State|~{{:Apertium-kum/stats/average}}%]]
|-
| apertium-lvs|| Latvian ||align="right"| - ||align="center"| - 
|-
| apertium-mkd|| Macedonian ||align="right"| {{#lst:apertium-mkd/stats|stems}}  ||align="center"| [[Apertium-kum#Current_State|~{{:Apertium-mkd/stats/average}}%]]
|-
| apertium-mlt|| Maltese ||align="right"| {{#lst:apertium-mlt/stats|stems}} ||align="center"| - 
|-
| apertium-nld|| Dutch ||align="right"| - ||align="center"| - 
|-
| apertium-nno|| [[Norwegian Nynorsk]] ||align="right" | {{#lst:apertium-nno/stats|stems}} ||align="center"| -
|-
| apertium-nob|| [[Norwegian Bokmål]] ||align="right" | {{#lst:apertium-nob/stats|stems}} ||align="center"| -
|-
| apertium-nog|| [[Nogay]] ||align="right"| {{#lst:apertium-nog/stats|stems}} ||align="center"| [[Apertium-nog#Current_State|~{{:Apertium-nog/stats/average}}%]]
|-
| apertium-rus|| [[Russian]] ||align="right"| {{#lst:apertium-rus/stats|stems}} ||align="center"| [[Apertium-rus#Current_State|~{{:Apertium-rus/stats/average}}%]]
|-
| apertium-san|| [[Sanskrit]] ||align="right"| {{#lst:apertium-san/stats|stems}} ||align="center"| - 
|-
| apertium-slv|| Slovenian ||align="right"| {{#lst:apertium-slv/stats|stems}}  ||align="center"| - 
|-
| apertium-sqi|| [[Albanian]] ||align="right"| {{#lst:apertium-sqi/stats|stems}} ||align="center"| [[Apertium-sqi#Current_State|~{{:Apertium-sqi/stats/average}}%]]
|-
| apertium-swe|| Swedish ||align="right"| - ||align="center"| - 
|-
| apertium-tat|| [[Tatar]] ||align="right"|  {{#lst:apertium-tat/stats|stems}} ||align="center"| [[Apertium-tat#Current_State|~{{:Apertium-tat/stats/average}}%]]
|-
| apertium-tuk|| [[Turkmen]] ||align="right"| {{#lst:apertium-tuk/stats|stems}} ||align="center"| [[Apertium-tuk#Current_State|~{{:Apertium-tuk/stats/average}}%]]
|-
| apertium-tur|| [[Turkish]] ||align="right"| {{#lst:apertium-tur/stats|stems}} ||align="center"| [[Apertium-tur#Current_State|~{{:Apertium-tur/stats/average}}%]]
|-
| apertium-ukr|| [[Ukrainian]] ||align="right"| {{#lst:apertium-ukr/stats|stems}} ||align="center"| - 
|-
| apertium-urd|| [[Urdu]] ||align="right"| {{#lst:apertium-urd/stats|stems}} ||align="center"| - 
|-
| apertium-uzb|| [[Uzbek]] ||align="right"| {{#lst:apertium-uzb/stats|stems}} ||align="center"| [[Apertium-uzb#Current_State|~{{:Apertium-uzb/stats/average}}%]]
|-
|}

=== Languages by family ===

* [[Turkic languages|Turkic]]: 
** Oghuz: [[Turkmen]], [[Turkish]]
** Kypchak: [[Kazakh]], [[Kyrgyz]], [[Tatar]], [[Bashqort]], [[Kumyk]], [[Nogay]]
** Other: [[Uzbek]], [[Chuvash]]
* [[Indo-European languages|Indo-European]]
** [[Slavic languages|Slavic]]: Russian, Serbo-Croatian, Macedonian, Czech, Bulgarian, Ukranian
** [[Celtic languages|Celtic]]: Scottish Gaelic
** [[Germanic languages|Germanic]]
*** [[West Germanic languages|West Germanic]]: Dutch
*** [[North Germanic languages|North Germanic]]: Danish, Icelandic, Norwegian (nno, nob), Swedish, Faroese
** [[Indic languages|Indic]]: [[Urdu]], [[Bengali]], [[Hindi]], [[Sanskrit]]
** [[Baltic languages|Baltic]]: Latvian
** Other: [[Albanian]], Armenian, Greek
* [[Semitic languages|Semitic]]: Maltese
* [[Uralic languages|Uralic]]: Finnish

=== Languages by region ===
* '''[[Languages of the Volga-Kama region|Volga-Kama]]''': [[Tatar]], [[Bashqort]], [[Chuvash]]
* '''[[Balkan languages|Balkans]]''': [[Albanian]], [[Bulgarian]], [[Greek]], [[Macedonian]], [[Serbo-Croatian]]
* '''[[Languages of the Caucasus|Caucasus]]''': [[Kumyk]], [[Nogay]]
* '''[[Languages of Central Asia|Central Asia]]''': [[Kazakh]], [[Kyrgyz]], [[Turkmen]], [[Uzbek]]

==Requiring a monolingual package as a dependency of a pair==
Say you want apertium-[http://www.ethnologue.com/language/fie fie]-[http://www.ethnologue.com/language/bar bar] to depend on some monolingual data from the apertium-bar package, e.g. <code>apertium-bar/bar.rlx</code> and maybe other such files.

This requires a recent version of apertium (-r48374 or later), and that you've exported PKG_CONFIG_PATH as described at [[Minimal_installation_from_SVN]].

Assuming apertium-bar is set up correctly (see next section), you can put the following line into the <code>configure.ac</code> of apertium-fie-bar:
<pre>
AP_CHECK_LING([2], [apertium-bar])
</pre>

and in the <code>Makefile.am</code>, you can write rules like this:
<pre>
bar-fie.rlx.bin: $(AP_SRC2)/bar.rlx
	cg-comp $< $@

bar-tat.automorf.bin: $(AP_LIB2)/bar.automorf.bin
	cp $< $@
</pre>

Similarly for apertium-fie (with <code>AP_CHECK_LING([1], [apertium-fie])</code>). By convention, a language pair called apertium-fie-bar should use the number 1 for fie and 2 for bar (though variants like 1b are possible too). Also by convention, AP_SRC should point to source files and AP_LIB to compiled binaries (this is the responsibility of the monolingual package, e.g. apertium-bar).

Now if you've typed "make install" in apertium-bar before running autogen.sh in apertium-fie-bar, apertium-fie-bar will use the bar.rlx and bar.automorf.bin which are installed by apertium-bar.


If you often make a lot of changes to apertium-bar and want to avoid having to "make install" for each and every change, you can do this in apertium-fie-bar:
<pre>
./autogen.sh --with-lang2=/path/to/apertium-bar
</pre>
Now each time you make, the "AP_SRC2" and "AP_LIB2" variables will both point to /path/to/apertium-bar instead of the "make install"-ed files. You can set it back to default by just running plain <code>autogen.sh</code> (or <code>./configure</code>) again.


See [[Installation_troubleshooting#AP_CHECK_LING_not_found_when_running_configure_or_autogen.sh]] if you run into errors about AP_CHECK_LING.

====Making a monolingual package dependable for pairs====
In apertium-bar, there should be a file <code>apertium-bar.pc.in</code>. This has to have the following lines:
<pre>
dir=@libdir@/apertium/apertium-bar
srcdir=@datarootdir@/apertium/apertium-bar
</pre>
These should correspond to where the binaries and source files respectively are installed by the <code>Makefile.am</code> in the monolingual package (typically the makefile names these directories <code>apertium_bardir</code> and <code>apertium_bar_srcdir</code>). 

The <code>configure.ac</code> should have a line saying something like <code>AC_OUTPUT([Makefile apertium-bar.pc])</code>. See https://svn.code.sf.net/p/apertium/svn/languages/apertium-nob for a working example.

Compiled / binary files should be listed in TARGETS_COMMON as usual, while any source files can be installed using install-data-local, e.g.:

<pre>
apertium_bar_srcdir=$(prefix)/share/apertium/$(BASENAME)/
install-data-local:
	test -d $(DESTDIR)$(apertium_bar_srcdir) || mkdir -p $(DESTDIR)$(apertium_bar_srcdir)
	$(INSTALL_DATA) $(BASENAME).$(LANG1).dix $(DESTDIR)$(apertium_bar_srcdir)
</pre>

Now if the apertium-fie-bar pair depends on apertium-bar as its lang2, it can refer to binaries (apertium-bar's TARGETS_COMMON) using $(AP_LIB2) and source files using $(AP_SRC2), e.g. <code>$(AP_SRC2)/apertium-$(LANG2).$(LANG2).dix</code> for the dix file in the install-data-local example above.

==See also==

* [[Incubator]]
* [[Nursery]]
* [[Staging]]

[[Category:Repository]]
[[Category:Terminology]]
[[Category:Documentation in English]]