https://wiki.apertium.org/w/index.php?action=history&feed=atom&title=Getnltk.pyGetnltk.py - Revision history2026-05-15T17:39:42ZRevision history for this page on the wikiMediaWiki 1.34.1https://wiki.apertium.org/w/index.php?title=Getnltk.py&diff=66194&oldid=prevShardulc: GitHub migration2018-03-10T02:32:37Z<p>GitHub migration</p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 02:32, 10 March 2018</td>
</tr><tr>
<td colspan="2" class="diff-lineno">Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td>
</tr>
<tr>
<td colspan="2" class="diff-empty diff-side-deleted"></td>
<td class="diff-marker" data-marker="+"></td>
<td class="diff-addedline diff-side-added"><div>{{Github-unmigrated-tool}}</div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td class="diff-context diff-side-deleted"><div>getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang]. The purpose is to make NLTK's Punkt sentence tokenizer work on Python 3.</div></td>
<td class="diff-marker"></td>
<td class="diff-context diff-side-added"><div>getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang]. The purpose is to make NLTK's Punkt sentence tokenizer work on Python 3.</div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td class="diff-context diff-side-deleted"><div><br /></div></td>
<td class="diff-marker"></td>
<td class="diff-context diff-side-added"><div><br /></div></td>
</tr>
</table>Shardulchttps://wiki.apertium.org/w/index.php?title=Getnltk.py&diff=37893&oldid=prevDtvrij74 at 00:54, 2 January 20132013-01-02T00:54:37Z<p></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 00:54, 2 January 2013</td>
</tr><tr>
<td colspan="2" class="diff-lineno">Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td>
</tr>
<tr>
<td class="diff-marker" data-marker="−"></td>
<td class="diff-deletedline diff-side-deleted"><div>getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang].</div></td>
<td class="diff-marker" data-marker="+"></td>
<td class="diff-addedline diff-side-added"><div>getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang]<ins class="diffchange diffchange-inline">. The purpose is to make NLTK's Punkt sentence tokenizer work on Python 3</ins>.</div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td class="diff-context diff-side-deleted"><div><br /></div></td>
<td class="diff-marker"></td>
<td class="diff-context diff-side-added"><div><br /></div></td>
</tr>
<tr>
<td class="diff-marker" data-marker="−"></td>
<td class="diff-deletedline diff-side-deleted"><div><del class="diffchange diffchange-inline">If you want to use NLTK's Punkt sentence tokenizer, you</del> can call <code>getnltk.py</code> in your Python 3 code like:</div></td>
<td class="diff-marker" data-marker="+"></td>
<td class="diff-addedline diff-side-added"><div><ins class="diffchange diffchange-inline">You</ins> can call <code>getnltk.py</code> in your Python 3 code like:</div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td class="diff-context diff-side-deleted"><div><pre></div></td>
<td class="diff-marker"></td>
<td class="diff-context diff-side-added"><div><pre></div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td class="diff-context diff-side-deleted"><div>py2output = subprocess.check_output(['python', 'getnltk.py', tosplit, lang])</div></td>
<td class="diff-marker"></td>
<td class="diff-context diff-side-added"><div>py2output = subprocess.check_output(['python', 'getnltk.py', tosplit, lang])</div></td>
</tr>
</table>Dtvrij74https://wiki.apertium.org/w/index.php?title=Getnltk.py&diff=37889&oldid=prevDtvrij74: Created page with 'getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang]. <br /> If you want t…'2013-01-02T00:49:56Z<p>Created page with 'getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang]. <br /> If you want t…'</p>
<p><b>New page</b></p><div>getnltk.py is located in <code>/trunk/apertium-tools/scraper/getnltk.py</code>. It was written by [http://wiki.apertium.org/wiki/User:Dtvrij74 Daniel Huang].<br />
<br /><br />
If you want to use NLTK's Punkt sentence tokenizer, you can call <code>getnltk.py</code> in your Python 3 code like:<br />
<pre><br />
py2output = subprocess.check_output(['python', 'getnltk.py', tosplit, lang])<br />
</pre><br />
* <code>tosplit</code> is the text that will be tokenized into sentences<br />
* <code>lang</code> is the 3-letter or 2-letter language code. Currently, it supports English, Russian, and Armenian.<br />
<br />
The sentences will be printed to the variable <code>py2output</code>. <code>xml2txt.py</code> (in the same directory) uses <code>getnltk.py</code>.</div>Dtvrij74