https://wiki.apertium.org/w/index.php?action=history&feed=atom&title=UDPipe 2026-04-07T15:08:31Z Revision history for this page on the wiki MediaWiki 1.34.1 https://wiki.apertium.org/w/index.php?title=UDPipe&diff=71194&oldid=prev 2020-03-09T19:43:57Z

<p>minor fix: a word was repeated accidentally</p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 19:43, 9 March 2020</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 51:</td> <td colspan="2" class="diff-lineno">Line 51:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>;Get more stuff!</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>;Get more stuff!</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>You'll<del class="diffchange diffchange-inline"> need</del> also need a couple of scripts from https://github.com/ftyers/ud-scripts</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>You'll also need a couple of scripts from https://github.com/ftyers/ud-scripts</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>&lt;pre&gt;</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>&lt;pre&gt;</div></td> </tr> </table>

Ilnar.salimzyan https://wiki.apertium.org/w/index.php?title=UDPipe&diff=65893&oldid=prev 2018-02-21T15:56:18Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 15:56, 21 February 2018</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>{{TOCD}}</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><br /></td> <td colspan="2" class="diff-empty diff-side-added"></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>==First things first==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>==First things first==</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=64745&oldid=prev 2017-11-24T07:19:38Z

<p><span dir="auto"><span class="autocomment">More ideas</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 07:19, 24 November 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 168:</td> <td colspan="2" class="diff-lineno">Line 168:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>Now try it on your own data.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>Now try it on your own data.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>==Using the CoNLL evaluation script==</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>Open this link: http://universaldependencies.org/conll17/evaluation.html</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>Then download the evaluation script [http://universaldependencies.org/conll17/eval.zip here].</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>Use the evaluation script like this:</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>&lt;pre&gt;</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>$ python3 evaluation_script/conll17_ud_eval.py gold_treebank.conllu system_output.conllu</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>&lt;/pre&gt;</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>==More ideas==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>==More ideas==</div></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62021&oldid=prev 2017-03-25T10:27:48Z

<p><span dir="auto"><span class="autocomment">Using the swap algorithm</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:27, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 97:</td> <td colspan="2" class="diff-lineno">Line 97:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>&lt;pre&gt;</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>&lt;pre&gt;</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>python3 conllu-extract-non-projective.py &lt; <del class="diffchange diffchange-inline">yourfile</del>.conllu &gt; <del class="diffchange diffchange-inline">yourfile</del>.nonproj.conllu</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>python3 conllu-extract-non-projective.py &lt; <ins class="diffchange diffchange-inline">tr-ud-train.conllu</ins>.conllu &gt; <ins class="diffchange diffchange-inline">tr-ud-train</ins>.nonproj.conllu</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>&lt;/pre&gt;</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>&lt;/pre&gt;</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62019&oldid=prev 2017-03-25T10:23:02Z

<p>Francis Tyers moved page <a href="/wiki/Udpipe" class="mw-redirect" title="Udpipe">Udpipe</a> to <a href="/wiki/UDPipe" title="UDPipe">UDPipe</a></p> <table class="diff diff-contentalign-left" data-mw="interface"> <tr class="diff-title" lang="en"> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:23, 25 March 2017</td> </tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div> </td></tr></table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62018&oldid=prev 2017-03-25T10:10:56Z

<p><span dir="auto"><span class="autocomment">More ideas</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:10, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 174:</td> <td colspan="2" class="diff-lineno">Line 174:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Download a treebank of a language you are interested in, and find out what percentage of trees are non-projective.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Download a treebank of a language you are interested in, and find out what percentage of trees are non-projective.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Find a bug in one of the scripts and report it on Github.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Find a bug in one of the scripts and report it on Github.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Describe an alternative weighting method for parser combination, could better results be had with learnt weights ?</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><br /></td> <td colspan="2" class="diff-empty diff-side-added"></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Tools|*]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Tools|*]]</div></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62017&oldid=prev 2017-03-25T10:07:29Z

<p><span dir="auto"><span class="autocomment">More ideas</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:07, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 173:</td> <td colspan="2" class="diff-lineno">Line 173:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Try training only on projective data. You can use the script &lt;code&gt;conllu-extract-projective.py&lt;/code&gt; to make a subset of your treebank that only has projective trees.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Try training only on projective data. You can use the script &lt;code&gt;conllu-extract-projective.py&lt;/code&gt; to make a subset of your treebank that only has projective trees.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Download a treebank of a language you are interested in, and find out what percentage of trees are non-projective.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Download a treebank of a language you are interested in, and find out what percentage of trees are non-projective.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Find a bug in one of the scripts and report it on Github.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Tools|*]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Tools|*]]</div></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62016&oldid=prev 2017-03-25T10:05:07Z

<p><span dir="auto"><span class="autocomment">First things first</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:05, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>==First things first==</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>==First things first==</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><br /></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>This section describes how to set up and train/test UDPipe. If you've already done this, then you can move on to the next part.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>;Get the code!</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>;Get the code!</div></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62015&oldid=prev 2017-03-25T10:04:05Z

<p><span dir="auto"><span class="autocomment">Classifier settings</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 10:04, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 137:</td> <td colspan="2" class="diff-lineno">Line 137:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>&lt;pre&gt;</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>&lt;pre&gt;</div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>udpipe --tokenizer none --tagger none --parser "hidden_layer=300" --train tur.<del class="diffchange diffchange-inline">h400</del>.udpipe &lt; tr-ud-train.conllu </div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>udpipe --tokenizer none --tagger none --parser "hidden_layer=300" --train tur.<ins class="diffchange diffchange-inline">h300</ins>.udpipe &lt; tr-ud-train.conllu </div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>&lt;/pre&gt;</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>&lt;/pre&gt;</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td class="diff-deletedline diff-side-deleted"><div>The default size is 200, try increasing it to 300 and see what happens.</div></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>The default size is 200, try increasing it to 300<ins class="diffchange diffchange-inline">, or decreasing it to 100</ins> and see what happens.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>;Train for a different number of iterations/epochs</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>;Train for a different number of iterations/epochs</div></td> </tr> </table>

Francis Tyers https://wiki.apertium.org/w/index.php?title=UDPipe&diff=62014&oldid=prev 2017-03-25T09:54:38Z

<p><span dir="auto"><span class="autocomment">More ideas</span></span></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 09:54, 25 March 2017</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 170:</td> <td colspan="2" class="diff-lineno">Line 170:</td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>* Try training only on projective data. You can use the script &lt;code&gt;conllu-extract-projective.py&lt;/code&gt; to make a subset of your treebank that only has projective trees.</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>* Try training only on projective data. You can use the script &lt;code&gt;conllu-extract-projective.py&lt;/code&gt; to make a subset of your treebank that only has projective trees.</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td class="diff-addedline diff-side-added"><div>* Download a treebank of a language you are interested in, and find out what percentage of trees are non-projective.</div></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><br /></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><br /></td> </tr> <tr> <td class="diff-marker"></td> <td class="diff-context diff-side-deleted"><div>[[Category:Tools|*]]</div></td> <td class="diff-marker"></td> <td class="diff-context diff-side-added"><div>[[Category:Tools|*]]</div></td> </tr> </table>

Francis Tyers