Lttoolbox API - Revision history

Jona: /* Using as a module from Python */

2017-03-10T13:19:06Z

Using as a module from Python

2014-10-07T13:09:57Z

Nouveau nom pour la page en français

2014-10-07T13:02:58Z

Link to French page

2012-03-24T11:39:47Z

Category:Documentation in English

2012-02-01T19:45:16Z

unknowns should always return the input word

2011-09-16T07:10:28Z

Using as a module from Python

2011-09-15T17:46:08Z

don't advocate the 'biltrans' function since it still has that trailing-garbage-bug

2011-09-15T17:45:04Z

tryToSetLocale for the non-ASCII, don't try to analyse zero-length strings

2011-09-15T17:41:02Z

tryToSetLocale for the non-ASCII

2011-08-17T12:17:41Z

link to bbqsrc :-)

@@ Line 80: / Line 80: @@
 Write the following files:
-libltpy.h:
+libltpy.hpp:
 <pre>
 #include <lttoolbox/fst_processor.h>
@@ Line 93: / Line 93: @@
 </pre>
-libltpy.cc:
+libltpy.cpp:
 <pre>
 #include "libltpy.hpp"
@@ Line 141: / Line 141: @@
 }
-EXTERN void free_analyses(wstring * analyses) {
+extern "C" void free_analyses(wstring * analyses) {
 	delete analyses;
 }

← Older revision		Revision as of 13:09, 7 October 2014
Line 1:		Line 1:
	[[Application ~~Lttoolbox~~\|En français]]		[[Application lttoolbox\|En français]]

	{{TOCD}}		{{TOCD}}

@@ Line 1: / Line 1: @@
+[[Application Lttoolbox|En français]]
 {{TOCD}}
 You can use [[lttoolbox]] as a library in C++ by with <code>#include <lttoolbox/fst_processor.h></code>, and with a bit more work, you can also use it from Python.
@@ Line 187: / Line 189: @@
 		if error.value != None:
 			self.__handle = 0
-			raise Exception(u"Initialization of fst failed: " + unicode(error.value, "UTF-8"))
+			raise Exception(u"Initialisation of fst failed: " + unicode(error.value, "UTF-8"))
 	def __del__(self):

@@ Line 246: / Line 246: @@
 [[Category:Morphological analysers]]
 [[Category:Development]]
+[[Category:Documentation in English]]

@@ Line 120: / Line 120: @@
 	else {
 		// a partial match:
-		return L"@"+analysis.first;
+		return L"@"+word;
 	}
 }

@@ Line 125: / Line 125: @@
 extern "C" wstring * analyse(Analyser * a, const wchar_t * word) {
-	// TODO: there must be a way to just send in a wstring in the first p
+	// It seems Python can only send wchar_t*, but we need a wstring
 	size_t wlen = wcslen(word);
 	if (wlen == 0) {
@@ Line 137: / Line 137: @@
 	wstring * out = new wstring(a->analyse(inputString));
 	return out;
+}
+EXTERN void free_analyses(wstring * analyses) {
+	delete analyses;
 }
@@ Line 194: / Line 198: @@
 	def analyse(self, word):
-		analyses = self.__lib.analyse(self.__handle, word)
+		ana_p = self.__lib.analyse(self.__handle, word)
-		if analyses:
+		if ana_p:
-			return analyses.contents.value
+			analysis = ana_p.contents.value
+		else:
+			analysis = ""
+		self.__lib.free_analyses(ana_p)
+		return analysis
 </pre>

@@ Line 114: / Line 114: @@
 wstring Analyser::analyse(wstring const &word) {
 	pair <wstring,int> analysis = fst.biltransWithQueue(word, false);
+	// The 'false' means we require no ^ or $ in input/output
-	// or fst.biltrans, which just returns the string. The 'false'
-	// means no ^ or $ in input/output
 	if (analysis.second == 0) {
 		return analysis.first;

@@ Line 95: / Line 95: @@
 #include "libltpy.hpp"
 #include <lttoolbox/fst_processor.h>
+#include <lttoolbox/lt_locale.h>
 using namespace std;
@@ Line 127: / Line 128: @@
 	// TODO: there must be a way to just send in a wstring in the first p
 	size_t wlen = wcslen(word);
+	if (wlen == 0) {
+		// avoid a bug in biltransWithQueue:
+		return 0;
+	}
 	wstring inputString = L"";
 	for (size_t i = 0; i < wlen; i++) {
@@ Line 136: / Line 141: @@
 extern "C" Analyser * init(const char ** error, const char * path) {
+	LtLocale::tryToSetLocale();
 	Analyser * a = 0;
 	try {
@@ Line 190: / Line 196: @@
 	def analyse(self, word):
 		analyses = self.__lib.analyse(self.__handle, word)
-		return analyses.contents.value
+		if analyses:
+			return analyses.contents.value
 </pre>

@@ Line 27: / Line 27: @@
 #include <lttoolbox/fst_processor.h>
+#include <lttoolbox/lt_locale.h>
 #include <lttoolbox/ltstr.h>
@@ Line 40: / Line 41: @@
 	}
+        LtLocale::tryToSetLocale();
 	FILE *t_rl = fopen(argv[1], "r");

@@ Line 72: / Line 72: @@
 ==Using as a module from Python==
-This example is based on how [[libvoikko]] uses lttoolbox for analysis. We make a C++ library that exposes whatever lttoolbox functions we need to Python, and a little Python class that makes calling those functions a bit more pythonic.<ref>An alternative might be to include Python.h in the C++ code, and define a full Python class from there, like how [https://launchpad.net/pylibtextcat pylibtextcat] creates a Python class for a C library.</ref>
+This example is based on how [[libvoikko]] uses lttoolbox for analysis. We make a C++ library that exposes whatever lttoolbox functions we need to Python, and a little Python class that makes calling those functions a bit more pythonic.<ref>An alternative might be to include Python.h in the C++ code, and define a full Python class from there, like how [https://launchpad.net/pylibtextcat pylibtextcat]/[https://github.com/bbqsrc/pylibtextcat py3libtextcat] creates a Python class for a C library.</ref>
 Write the following files: