Difference between revisions of "Bitextor"
Jump to navigation
Jump to search
(Added tagaligner - related to bitextor) |
|||
| Line 1: | Line 1: | ||
'''Bitextor''': is an application whose objective is to generate translation memories using as multilingual websites as a corpus source. It downloads all the HTML files in a website, it performs a preprocess to convert them to a coherent and suitable format and, finally, applies a set of heuristics (based mainly on HTML tag structure and text block length) to make pairs of files which are candidates to contain the same text in different languages. From these candidates, translation memories are generated in TMX format using the library LibTagAligner, which uses the HTML tags and the length of text chunks to perform the alignment. |
|||
'''Bitextor''' is a program for crawling multilingual websites and creating TMX files from aligned pages. |
|||
==See also== |
==See also== |
||
| Line 7: | Line 7: | ||
==External links== |
==External links== |
||
* [http://bitextor.sourceforge.net |
* [http://bitextor.sourceforge.net Bitextor project web] or [http://bitextor.wiki.sourceforge.net Bitextor's wiki (documentation)] |
||
* [http://tag-aligner.sourceforge.net |
* [http://tag-aligner.sourceforge.net TagAligner's project web] [http://tag-aligner.wiki.sourceforge.net TagAligner's wiki (documentation)] |
||
* [http://en.wikipedia.org/wiki/Translation_Memory_eXchange TMX on Wikipedia] |
* [http://en.wikipedia.org/wiki/Translation_Memory_eXchange TMX on Wikipedia] |
||
* [http://www.lisa.org/fileadmin/standards/tmx1.4/tmx.htm TMX 1.4b specification] |
|||
==Tools used by Bitextor== |
|||
* [http://software.wise-guys.nl/libtextcat/ LibTextCat (non official)] |
|||
* [http://tidy.sourceforge.net/ TidyHTML] |
|||
* [http://xmlsoft.org/ LibXML2] |
|||
* [https://sourceforge.net/projects/freshmeat_enca/ LibEnca] |
|||
* [https://sourceforge.net/projects/freshmeat_tre/ LibTRE] |
|||
[[Category:Tools]] |
[[Category:Tools]] |
||
Revision as of 17:04, 12 May 2009
Bitextor: is an application whose objective is to generate translation memories using as multilingual websites as a corpus source. It downloads all the HTML files in a website, it performs a preprocess to convert them to a coherent and suitable format and, finally, applies a set of heuristics (based mainly on HTML tag structure and text block length) to make pairs of files which are candidates to contain the same text in different languages. From these candidates, translation memories are generated in TMX format using the library LibTagAligner, which uses the HTML tags and the length of text chunks to perform the alignment.
See also
External links
- Bitextor project web or Bitextor's wiki (documentation)
- TagAligner's project web TagAligner's wiki (documentation)
- TMX on Wikipedia
- TMX 1.4b specification
