Bitextor

Bitextor: is an application whose objective is to generate translation memories using as multilingual websites as a corpus source. It downloads all the HTML files in a website, it performs a preprocess to convert them to a coherent and suitable format and, finally, applies a set of heuristics (based mainly on HTML tag structure and text block length) to make pairs of files which are candidates to contain the same text in different languages. From these candidates, translation memories are generated in TMX format using the library LibTagAligner, which uses the HTML tags and the length of text chunks to perform the alignment.

See also

• Tools for TMX

External links

• Bitextor project web or Bitextor's wiki (documentation)
• TagAligner's project web TagAligner's wiki (documentation)
• TMX on Wikipedia
• TMX 1.4b specification

Tools used by Bitextor

• LibTextCat (non official)
• TidyHTML
• LibXML2
• LibEnca
• LibTRE