https://wiki.apertium.org/w/index.php?action=history&feed=atom&title=The_Right_Way_to_count_lexc_stems 2026-05-05T10:45:38Z Revision history for this page on the wiki MediaWiki 1.34.1 https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=66198&oldid=prev 2018-03-10T02:42:03Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 02:42, 10 March 2018</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>{{Github-unmigrated-tool}}</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Challenges ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Challenges ==</div></td> </tr> </table>

Shardulc https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=60149&oldid=prev 2016-09-26T12:18:13Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 12:18, 26 September 2016</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 28:</td> <td colspan="2" class="diff-lineno">Line 28:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Documentation]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Documentation]]</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>[[Category:Documentation in English]]</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Tools]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Tools]]</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Lexc]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Lexc]]</div></td> </tr> </table>

Rcrowther https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=51164&oldid=prev 2014-12-05T05:45:34Z

<p><span dir="auto"><span class="autocomment">See Also</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:45, 5 December 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 29:</td> <td colspan="2" class="diff-lineno">Line 29:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Documentation]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Documentation]]</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Tools]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Tools]]</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>[[Category:Lexc]]</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=49971&oldid=prev 2014-08-24T23:58:12Z

<p><span dir="auto"><span class="autocomment">How we&#039;re doing it now</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 23:58, 24 August 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 17:</td> <td colspan="2" class="diff-lineno">Line 17:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>#* Add the entries of each lexicon the Root lexicon contains a pointer towards to a global entries set.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>#* Add the entries of each lexicon the Root lexicon contains a pointer towards to a global entries set.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>#* If there are pointers present in these lexicon, follow them as well and add their entries to the global entries set.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>#* If there are pointers present in these lexicon, follow them as well and add their entries to the global entries set.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>#* ASSUMPTION: Root lexicon points to exactly the set of lexica with lexical items</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div># Output the length of the accumulated entries set, a number representative of the unique stems present in the LEXC dictionary.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div># Output the length of the accumulated entries set, a number representative of the unique stems present in the LEXC dictionary.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46545&oldid=prev 2014-02-04T22:25:12Z

<p><span dir="auto"><span class="autocomment">Challenges: </span>link &#039;dix&#039; to &#039;Monodix basics&#039; page</span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 22:25, 4 February 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 2:</td> <td colspan="2" class="diff-lineno">Line 2:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Challenges ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Challenges ==</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>* Unlike [[dix]] format, lexc is not xml. ...</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Unlike [[<ins class="diffchange diffchange-inline">Monodix basics|</ins>dix]] format, lexc is not xml. ...</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Entries might be repeated</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Entries might be repeated</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Ilnar.salimzyan https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46532&oldid=prev 2014-02-04T19:47:21Z

<p><span dir="auto"><span class="autocomment">Challenges</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 19:47, 4 February 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 3:</td> <td colspan="2" class="diff-lineno">Line 3:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Unlike [[dix]] format, lexc is not xml. ...</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Unlike [[dix]] format, lexc is not xml. ...</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Entries might be repeated</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>=== Multiple entries for a single stem. ===</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>=== Multiple entries for a single stem. ===</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* ...</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><br /></td> <td colspan="2" class="diff-empty diff-side-added"></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== How we're doing it now ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== How we're doing it now ==</div></td> </tr> </table>

Firespeaker https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46341&oldid=prev 2014-01-08T03:10:33Z

<p><span dir="auto"><span class="autocomment">How we&#039;re doing it now</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 03:10, 8 January 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 8:</td> <td colspan="2" class="diff-lineno">Line 8:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== How we're doing it now ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== How we're doing it now ==</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>The current approach is to recurse through the LEXC file, <del class="diffchange diffchange-inline">following</del> only lexica pointed to from Root and lexica pointed to by those, counting only '''unique''' entries (by stem and continuation lexicon) in each one.</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>The current approach is to recurse through the LEXC file, <ins class="diffchange diffchange-inline">considering</ins> only lexica pointed to from Root and lexica pointed to by those,<ins class="diffchange diffchange-inline"> and</ins> counting only<ins class="diffchange diffchange-inline"> the</ins> '''unique''' entries (by stem and continuation lexicon) in each one.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div># Iterate through each line of the LEXC file, maintaining a record of the current lexicon. </div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div># Iterate through each line of the LEXC file, maintaining a record of the current lexicon. </div></td> </tr> </table>

Sushain https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46340&oldid=prev 2014-01-08T03:09:51Z

<p><span dir="auto"><span class="autocomment">How we&#039;re doing it now</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 03:09, 8 January 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 8:</td> <td colspan="2" class="diff-lineno">Line 8:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== How we're doing it now ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== How we're doing it now ==</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>The current approach is to recurse through the LEXC file, following only lexica pointed to from Root and lexica pointed to by those, counting only '''unique''' entries (by stem and continuation lexicon) in each one.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div># Iterate through each line of the LEXC file, maintaining a record of the current lexicon. </div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div># Iterate through each line of the LEXC file, maintaining a record of the current lexicon. </div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>#* Upon encountering an entry, attempt to parse the entry and add a tuple of the lemma and continuation lexicon to a set labeled by the current lexicon name. </div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>#* Upon encountering an entry, attempt to parse the entry and add a tuple of the lemma and continuation lexicon to a set labeled by the current lexicon name. </div></td> </tr> </table>

Sushain https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46339&oldid=prev 2014-01-08T03:04:53Z

<p><span dir="auto"><span class="autocomment">How we&#039;re doing it now</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 03:04, 8 January 2014</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 8:</td> <td colspan="2" class="diff-lineno">Line 8:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== How we're doing it now ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== How we're doing it now ==</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div># Iterate through each line of the LEXC file, maintaining a record of the current lexicon. </div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><br /></td> <td colspan="2" class="diff-empty diff-side-added"></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>#* Upon encountering an entry, attempt to parse the entry and add a tuple of the lemma and continuation lexicon to a set labeled by the current lexicon name. </div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>#* Upon encountering a pointer to another lexicon, add the pointer to a list labeled by the current lexicon name. </div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div># After processing the entire file, lookup the Root lexicon in the stored data and iterate through its pointers</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>#* Add the entries of each lexicon the Root lexicon contains a pointer towards to a global entries set.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>#* If there are pointers present in these lexicon, follow them as well and add their entries to the global entries set.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div># Output the length of the accumulated entries set, a number representative of the unique stems present in the LEXC dictionary.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>== Ready-made script ==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>== Ready-made script ==</div></td> </tr> </table>

Sushain https://wiki.apertium.org/w/index.php?title=The_Right_Way_to_count_lexc_stems&diff=46337&oldid=prev 2014-01-07T23:43:47Z

<p>Created page with &quot; == Challenges == * Unlike <a href="/wiki/Dix" class="mw-redirect" title="Dix">dix</a> format, lexc is not xml. ... === Multiple entries for a single stem. === == How we&#039;re doing it now == == Ready-made script == [https:...&quot;</p> <p><b>New page</b></p><div><br /> == Challenges ==<br /> <br /> * Unlike [[dix]] format, lexc is not xml. ...<br /> <br /> === Multiple entries for a single stem. ===<br /> <br /> <br /> == How we&#039;re doing it now ==<br /> <br /> <br /> == Ready-made script ==<br /> [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/lexccounter.py lexccounter.py]<br /> <br /> == See Also ==<br /> <br /> * [[The Right Way to count dix stems]]<br /> <br /> [[Category:Documentation]]<br /> [[Category:Tools]]</div>

Firespeaker