Search results
Jump to navigation
Jump to search
Page title matches
- '''Detect hidden unknown words by using the probabilities of the HMM-based part-of-speech tagger in ...orms for which there exists at least one lexical form cannot be considered unknown and there is no way to know whether the set of possible lexical forms provi2 KB (277 words) - 19:51, 24 March 2020
- ...interchunk, this is quite easy, as each unknown word has the chunk lemma 'unknown', but it's un- or under-documented how this should be done using apertium-t2 KB (209 words) - 11:06, 24 March 2012
Page text matches
- <li>^unknown<NP><m><sg>{^hole<n><sg>/agujero<n><m><sg>$}$</li></ol> <li>^unknown<DP><m><sg>{^a<det><ind><sg>/uno<det><ind><GD><sg>$ ^unknown<NP><m><sg>{^hole<n><sg>/agujero<n><m><sg>$}$}$</li></ol>33 KB (6,259 words) - 06:07, 1 June 2023
- ...the project, with the help of mentors on Kipchak languages. Most frequent unknown tokens from corpora of each language (mostly consisting of Wikipedia entrie Number of unknown words (marked with a star) in test: 1247 KB (798 words) - 18:30, 26 August 2019
- Number of unknown words (marked with a star) in test: 78<br> Percentage of unknown words: 6.61 %<br>17 KB (2,274 words) - 06:14, 27 August 2020
- Number of unknown words (marked with a star) in test: 4 Percentage of unknown words: 1.10 %4 KB (404 words) - 00:19, 3 July 2012
- Number of unknown words (marked with a star) in test: 23 Percentage of unknown words: 7,10 %39 KB (5,922 words) - 07:37, 20 March 2014
- Here is the WER result before I added the unknown words/wrote some CG rules for the text: Number of unknown words (marked with a star) in test:5 KB (607 words) - 13:25, 12 August 2018
- Number of unknown words (marked with a star) in test: 2 Percentage of unknown words: 0.37 %6 KB (728 words) - 19:47, 8 May 2014
- Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %4 KB (563 words) - 16:24, 21 March 2014
- .../usr/lib/gcc/x86_64-unknown-linux-gnu/4.8.2/crtendS.o /usr/lib/gcc/x86_64-unknown-linux-gnu/4.8.2/../../../../lib/crtn.o -O3 -mtune=nocona -Wl,-soname -Wl g++: error: /usr/lib/gcc/x86_64-unknown-linux-gnu/4.8.2/../../../../lib/crti.o: No such file or directory20 KB (3,153 words) - 08:13, 24 May 2019
- ...orpus on which further translations will be made. Evaluations not allowing unknown words will give a better indication of "best-case" working of transfer rule ! Translator !! Date !! Version !! Direction !! Unknown<br/>words !! data-sort-type="number"|WER !! data-sort-type="number"|PWER !!9 KB (1,233 words) - 09:10, 21 November 2021
- unknown=$(grep -c '/\*' $outfile) known_percent=$(calc -p "round( 100*($total-$unknown-$bidix_unknown)/$total, 3)")4 KB (583 words) - 15:18, 10 January 2022
- ...r rules that work on <np>-tagged words do not apply when the word is unknown. Another is that proper nouns can be ambiguous with other, known words, and ==Unknown proper nouns in transfer==3 KB (492 words) - 16:52, 10 March 2018
- ...known noun2, prep det unknown adjec noun, prep det unknown noun, sup-adjec unknown nom. ***Another possibility (Aida): detect unknown capitalized words (possible?). We tried with regular expressions but they20 KB (2,856 words) - 06:26, 27 May 2021
- ...line coverage for releasing a new prototype translator is around 80%, or 2 unknown words in 10 for a given corpus. This is not enough to make revision practic Number of unknown words (marked with a star) in test:18 KB (2,490 words) - 12:00, 31 January 2012
- ...line coverage for releasing a new prototype translator is around 80%, or 2 unknown words in 10 for a given corpus. This is not enough to make revision practic Number of unknown words (marked with a star) in test:18 KB (2,493 words) - 08:39, 10 May 2013
- ...line coverage for releasing a new prototype translator is around 80%, or 2 unknown words in 10 for a given corpus. This is not enough to make revision practic Number of unknown words (marked with a star) in test:18 KB (2,493 words) - 10:59, 30 October 2015
- Number of unknown words (marked with a star) in test: 156 Percentage of unknown words: 11.86 %2 KB (236 words) - 08:55, 16 January 2016
- Number of unknown words (marked with a star) in test: 284 Percentage of unknown words: 91.91 %5 KB (515 words) - 14:34, 1 September 2019
- ...d into misunderstanding the content, instead of observing that there is an unknown word. ...rmous increase in transfer complexity – all tags have to be presumed to be unknown, and developer time is wasted on bug-hunting and workarounds instead of imp4 KB (679 words) - 16:06, 3 May 2020
- Number of unknown words (marked with a star) in test: 653 Percentage of unknown words: 17.48 %23 KB (3,704 words) - 11:56, 16 December 2020
- ==Matching unknown words in Apertium== lttoolbox prepends a star to unknown words, so you can match unknown words using a simple regexp matching that star:7 KB (1,116 words) - 20:57, 2 April 2021
- ...the OR operation, the rules would try to match precisely a sequence of one unknown word followed by one known one. ====Matching an unknown word====19 KB (2,820 words) - 15:26, 11 April 2023
- Number of unknown words (marked with a star) in test: 271 Percentage of unknown words: 23.42 %27 KB (4,372 words) - 11:33, 14 October 2009
- Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %3 KB (341 words) - 02:07, 10 March 2018
- ...gernt.com/dict.shtml English-Chinese Online Dictionary] TigerNT '''license unknown''' ...ses.b5.gz Chinese Community Information Center Corpora] FTP .gz '''license unknown'''16 KB (2,148 words) - 03:28, 16 December 2015
- Number of unknown words (marked with a star) in test: 203<br/> Percentage of unknown words: 8,24 %<br/>81 KB (13,134 words) - 16:48, 30 September 2011
- | <code>GD</code> || Gender to be determined || || <!-- unknown --> ...ity to be determined || if the sub-category is (currently) unknown || <!-- unknown -->38 KB (4,492 words) - 15:36, 9 May 2024
- ...we had approx 13,000 entries. Approx half of the training sentences had an unknown word. With this we got very poor tagger performance. Then we added 7,000 pr ...My dix is not big enough, and approx half of the training sentences has an unknown word. Can't I just grep these sentences away, and then train on the rest?7 KB (1,177 words) - 08:34, 8 October 2014
- and the unknown analysis string <code>a<c></code> a score of ...er scores to unknown analysis strings with frequent <math>a</math> than to unknown analysis strings with infrequent <math>a</math> .20 KB (3,229 words) - 20:06, 12 March 2018
- Number of tokenised words unknown to analyser: 63730 — 43.1 % of tokens had * unknown to bidix: 112 — 0.1 % of tokens had @4 KB (496 words) - 18:27, 19 June 2017
- ...%BBB% and run it through Apertium's %AAA%-%BBB% translator to identify 50 unknown forms. Add the stems of these forms to the analyser in an appropriate way ...%BBB% and run it through Apertium's %AAA%-%BBB% translator to identify 50 unknown forms. Add the stems of these forms to the analyser in an appropriate way32 KB (4,862 words) - 06:23, 5 December 2019
- echo "TOP UNKNOWN WORDS:" UNKNOWN=`cat /tmp/$LG.parade.txt | grep '\*' | wc -l`864 bytes (139 words) - 02:14, 6 September 2019
- ...etc. By the time you finish you should have a reasonable model of missing unknown words. <match case="Aa" unknown="true"><add-reading tags="np.ant"/></match>4 KB (558 words) - 13:07, 26 June 2020
- ==Adding/fixing unknown words== If you have some words that are unknown in a certain language pair, you can help out by simply writing a list of wo3 KB (549 words) - 09:17, 26 May 2021
- ...words as opposed to "blank" chars. Its main effect is on tokenisation of ''unknown'' words, since non-alphabet characters may still be part of a ''known'' wor ...a word not in the dictionary, but composed of alphabetic chars, we get an unknown-word analysis:2 KB (400 words) - 08:52, 28 April 2014
- ==I get "Unknown option --xpath"==5 KB (863 words) - 09:04, 10 October 2017
- ==How do I see unknown words?==2 KB (331 words) - 12:03, 28 February 2017
- *'''-f --missing-freqs:''' path to sqlite3 database of words that were unknown (requires <code>sudo apt-get install sqlite3</code>) *'''markUnknown=no''' (optional): include this to remove "*" in front of unknown words37 KB (5,132 words) - 16:36, 5 June 2020
- === Unknown ===8 KB (1,234 words) - 17:01, 3 December 2020
- ===Unknown===38 KB (6,273 words) - 11:01, 24 December 2020
- Number of unknown words (marked with a star) in test: 117<br/> Percentage of unknown words: 3,87 %<br/>6 KB (845 words) - 20:08, 3 October 2011
- Both [[lttoolbox]] and [[HFST]] have methods for dynamically analysing unknown compound words into their constituent parts. See below for how it's done in ..., and only do compounding if the other methods would give an unknown word. Unknown words are made up of strings of characters from <alphabet>, separated16 KB (2,689 words) - 09:07, 6 April 2021
- Number of unknown words (marked with a star) in test: 117<br/> Percentage of unknown words: 3,87 %<br/>98 KB (16,331 words) - 20:28, 30 September 2011
- Note: Reference translation MUST have no unknown-word marks, even if systems that do not mark unknown words with a star.6 KB (981 words) - 09:13, 21 November 2021
- hsb.dix:25: element s: validity error : IDREF attribute n references an unknown ID "nom" hsb.dix:33: element s: validity error : IDREF attribute n references an unknown ID "nom"19 KB (3,440 words) - 12:10, 26 September 2016
- ...interchunk, this is quite easy, as each unknown word has the chunk lemma 'unknown', but it's un- or under-documented how this should be done using apertium-t2 KB (209 words) - 11:06, 24 March 2012
- hsb.dix:25: element s: validity error : IDREF attribute n references an unknown ID "nom" hsb.dix:33: element s: validity error : IDREF attribute n references an unknown ID "nom"25 KB (2,260 words) - 18:36, 12 January 2012
- === Unknown ===4 KB (682 words) - 11:14, 16 April 2012
- '''Detect hidden unknown words by using the probabilities of the HMM-based part-of-speech tagger in ...orms for which there exists at least one lexical form cannot be considered unknown and there is no way to know whether the set of possible lexical forms provi2 KB (277 words) - 19:51, 24 March 2020
- ...m Wikipedia, newspapers, literature, etc.) '''detect the 250 most frequent unknown words''' (words in the source document which are not in the dictionary). S ...opriate <code>.dix</code> or <code>.lexc</code> file) so that they are not unknown anymore. Make sure to categorise stems correctly (this can be hard, so ple2 KB (299 words) - 19:44, 30 December 2019
- ...m Wikipedia, newspapers, literature, etc.) '''detect the 200 most frequent unknown words''' (words in the source document which are not in the bilingual dicti ...ropriate <code>.dix</code> file) in [[bidix]] format (so that they are not unknown anymore), as well as the monolingual analysers if needed. Make sure to cat2 KB (320 words) - 15:01, 19 January 2020
- <pre>LIST unknown = ("\\*.*"r) ; </pre> <pre>SELECT proper-name IF (1 unknown);</pre>8 KB (1,211 words) - 23:02, 4 April 2021
- ...high, and compares with commercial systems -- over 95% coverage (around 5 unknown words out of 100 words), and between 3-7% word-error rate (out of 100 words ...final coverage of the system was around 90%, e.g. over a set of corpora 10 unknown words out of 100 on average. The word-error rate was around 17%, meaning th12 KB (1,679 words) - 12:00, 31 January 2012
- ...in extending dictionaries by assigning stems and inflectional paradigms to unknown words] (pp.19-26.). EAMT 2014 – 17th Annual conference of the European As ...sites/default/files/FreeRBMT-2012.pdf#33 Choosing the correct paradigm for unknown words in rule-based machine translation systems]. Third International Works33 KB (4,418 words) - 11:52, 29 December 2021
- echo unknown; coverage = 1 - unknown / total6 KB (625 words) - 16:54, 1 July 2013
- ...orpus, using your existing analyser, and tagger to give possible values to unknown words <spectie> you would assign possible values for case/number/gender to the unknown surface forms of *fizikalne and *matematične based4 KB (611 words) - 14:26, 10 February 2015
- ...high, and compares with commercial systems -- over 95% coverage (around 5 unknown words out of 100 words), and between 3-7% word-error rate (out of 100 words ...final coverage of the system was around 90%, e.g. over a set of corpora 10 unknown words out of 100 on average. The word-error rate was around 17%, meaning th12 KB (1,683 words) - 08:42, 10 May 2013
- ...from Wikipedia, newspapers, literature, etc.) detect the 50 most frequent unknown words (source words which are not in the dictionaries of the language pair # add these words to the source dictionary (so that they are not unknown anymore), add the correspondence to the bilingual dictionary, and add the w2 KB (271 words) - 05:34, 17 December 2015
- ...rus-nova.txt, -ref = tat-rus-posted.txt). WER / PER results are given when unknown-word marks (stars) are not removed. ...if it's usable by that time. || '''Midterm evaluation'''<br/>Results when unknown word-marks (stars) are not removed<br/>tat-rus/texts/text1.* (full coverage8 KB (1,006 words) - 12:48, 9 March 2018
- -e: morphological analysis, with compound analysis on unknown words -n: morph. generation without unknown word marks9 KB (1,370 words) - 09:49, 7 April 2020
- ...high, and compares with commercial systems -- over 95% coverage (around 5 unknown words out of 100 words), and between 3-7% word-error rate (out of 100 words ...final coverage of the system was around 90%, e.g. over a set of corpora 10 unknown words out of 100 on average. The word-error rate was around 17%, meaning th12 KB (1,683 words) - 11:00, 30 October 2015
- ...verb conjugations, declensions, etc. More generically, upon finding a new unknown word, we can productively generate all its inflections according to every p ...ome constraints, which we can use in order to gather information about an unknown word. More generically, we can gather information about a word knowing whic6 KB (928 words) - 13:57, 3 April 2009
- ...smi="v|tv|fut|p1|sg" si="root" UpCase="none" lem="iç" mi="v|tv|fut|p1|sg" unknown="transfer"> ...="0" slem="bira" smi="n|acc" si="dobj" UpCase="none" lem="bira" mi="n|acc" unknown="transfer">53 KB (8,811 words) - 04:05, 21 January 2017
- ...analysis. This could happen by changing lt-proc (fst_processor.cc) so that unknown words are sent to a decompounding-function that tries various strategies (l * If the first member is unknown, choose the analysis with the longest last member.13 KB (2,051 words) - 10:24, 22 September 2010
- |unknown |REGLA: unknown45 KB (7,840 words) - 10:56, 18 September 2017
- * unknown input character to one of a number of characters3 KB (513 words) - 12:26, 26 September 2016
- ...ed and unreleased pairs such as English-Afrikaans, the accuracy, excluding unknown26 KB (3,122 words) - 06:25, 27 May 2021
- * Add top stems from frequency lists of unknown forms8 KB (975 words) - 06:42, 23 September 2013
- ERROR APER1168: some unknown failed assertion...74 bytes (9 words) - 09:55, 28 August 2023
- ...analysis of the string up until the '.', then we may immediately output an unknown.3 KB (541 words) - 07:20, 8 June 2019
- '''Percentage of unknown words:''' 2.44 %9 KB (1,370 words) - 13:58, 23 August 2016
- ...y, and give you the number of tokenised words, coverage percentage and top unknown words. It also displays the speed it translated the whole corpus, and it's12 KB (1,931 words) - 17:06, 24 October 2018
- * <s>Allow users to set 'mark unknown words' or not.</s>3 KB (490 words) - 06:26, 27 May 2021
- ...nguages with different writing systems where you want to ''transliterate'' unknown words into the other writing system. For example:2 KB (426 words) - 12:19, 26 September 2016
- ERROR APLT1017: On file \"{file}\" line {line}: Unknown macro \"{macro}\".100 bytes (13 words) - 07:43, 29 August 2023
- ...separated and there are few special characters. <code>#</code> is for any unknown entry, <code>!</code> for a different pos (here, the entry 'শাসক' w4 KB (690 words) - 13:05, 25 August 2009
- ''Evaluation'': Results when removing unknown-word marks (stars) Edit distance: 92 Word error rate (WER): 31.94 % Number21 KB (3,171 words) - 14:34, 3 April 2017
- ...s to impose, and, in any case, the students who will be doing the work are unknown to the rest of us.18 KB (2,991 words) - 22:24, 3 August 2013
- If you have some words that are unknown in a certain language pair, you can help out by simply writing list of word7 KB (1,139 words) - 06:27, 27 May 2021
- ! MT version !! Date !! Words translated !! Unknown words !! Percent !! Notes583 bytes (70 words) - 12:19, 15 August 2013
- ERROR APRC1001: FST has features that are unknown to this version of lttoolbox - upgrade!115 bytes (18 words) - 13:14, 31 August 2023
- &markup, &unknown);5 KB (680 words) - 16:10, 13 May 2010
- ...cognates through Turkish, corpora were examined to determine and ascertain unknown words' meanings and Persian, Arabic and Russian vocabulary were used to goo4 KB (551 words) - 23:52, 28 August 2017
- A star * means a word was unknown to the translator and passed through unchanged. For proper nouns, this is o3 KB (427 words) - 18:56, 26 September 2016
- * Alt-U: Set/unset 'mark unknown words'10 KB (1,606 words) - 20:54, 20 February 2022
- The analysis of an unknown word is (ignoring the full stop information):50 KB (7,915 words) - 00:04, 10 March 2019
- * How about unknown words...5 KB (788 words) - 10:50, 9 February 2015
- ERROR APRC1032: Unknown operator \"{operator}\".74 bytes (8 words) - 13:21, 31 August 2023
- ...icial form. The <code>-e</code> option is for dynamic [[decompounding]] of unknown words.4 KB (647 words) - 07:45, 8 October 2014
- ...ions. The word is the question, and the possible analyses are the answers. Unknown words can be thought of as questions we don't know what the possible answer2 KB (294 words) - 09:47, 12 November 2017
- The analysis of an unknown word is (ignoring the full stop information):10 KB (1,626 words) - 17:46, 13 January 2020
- | [[Matching unknown words]]13 KB (1,601 words) - 23:31, 23 July 2021
- # Check words in corpus which are analysed, but then have an apostrophe and unknown word after (e.g. case ending) ... perhaps they need to be added as proper n2 KB (378 words) - 18:27, 8 March 2018
- ...ions. The word is the question, and the possible analyses are the answers. Unknown words can be thought of as questions we don't know what the possible answer13 KB (2,076 words) - 12:13, 26 September 2016
- ERROR ALT80590: Transducer has features that are unknown to this version of lttoolbox - upgrade!122 bytes (18 words) - 21:46, 31 October 2023
- * Get unknown words from chunked text and sort by frequency:570 bytes (92 words) - 06:24, 27 June 2010
- * Valayapathi, Unknown Jain Ascetic, Jain work of 9th Century CE; Link - https://www.worldlibrary.3 KB (441 words) - 15:04, 27 December 2017
- ...s, for example by removing rules with conjunctions, or removing rules with unknown words.15 KB (2,206 words) - 13:58, 7 October 2014
- ...t using the morphological analyser and an alphabet defined for breaking up unknown words.1 KB (201 words) - 07:12, 24 February 2023
- | 1 1 <U> || n/a || unknown4 KB (492 words) - 08:29, 17 January 2013
- ...gh ca-en.autobil.bin, you'll get the same analysis out. If not, you'll get unknown word.10 KB (1,595 words) - 02:25, 10 March 2018
- ERROR ALT80620: FST has features that are unknown to this version of lttoolbox - upgrade!115 bytes (18 words) - 21:47, 31 October 2023
- ...sing words, add these words to the source dictionary (so that they are not unknown anymore), add the correspondence to the bilingual dictionary, and add the w1 KB (186 words) - 09:43, 4 November 2014
- ...navigation seems to depend on 'See also', 'External links', and searching unknown words in wiki pages.10 KB (1,668 words) - 02:46, 10 February 2018
- ...ent for the current hidden-Markov-model tagger. It should have support for unknown words, and also for "forbid" descriptions (not described in the paper). The2 KB (251 words) - 00:37, 6 April 2013
- ERROR LTTB1059: Transducer has features that are unknown to this version of lttoolbox - upgrade!122 bytes (18 words) - 23:43, 25 August 2023
- ...f>See [[Alphabet]] for how the alphabet affects blanks and tokenisation of unknown words.</ref> it will look something like:11 KB (1,851 words) - 07:42, 16 February 2015
- ...input string and for each word returns whether the word is correct, and if unknown returns suggestions. Whether segmentation is done by the client or by aper68 KB (10,323 words) - 15:37, 25 October 2014
- ...specified in the alphabet, it is dealt with as whitespace, so e.g. you get unknown words split in two so you can end up with stuff like ^G$ö^k$ı^rmak$ which23 KB (3,198 words) - 09:15, 4 March 2024
- :: Unknown if this sketch uses the official orthography.2 KB (318 words) - 08:55, 17 January 2013
- ...rtium-pn-recogniser''' detects proper nouns in the input and marks them as unknown words so that the rest of the modules in the pipeline do not process them.801 bytes (124 words) - 07:43, 16 October 2018
- ...slation (translation as you type) and support for disabling the marking of unknown tokens. Language detection is supported with CLD with plans to migrate to a17 KB (2,558 words) - 05:25, 24 October 2019
- ERROR LTTB1062: FST has features that are unknown to this version of lttoolbox - upgrade!115 bytes (18 words) - 23:43, 25 August 2023
- {#unknown{^*TOCD}}53 KB (8,542 words) - 10:15, 14 January 2008
- If this comes out as an unknown word, then the fault is probably in your bilingual dictionary <code>apertiu6 KB (984 words) - 17:56, 12 March 2016
- ...alpha' or '-pre' tag, for situations where the likely full release date is unknown, and known, respectively.4 KB (660 words) - 22:17, 3 August 2013
- .... It should also (optionally) output hitparades (e.g., frequency lists of unknown forms in the corpus).2 KB (246 words) - 02:32, 1 June 2019
- ...missing in translations from [[apertium-af-nl|Afrikaans-Dutch]]. A list of unknown words can be provided.||align=center| 3–6 || [[User:AureiAnimus|Pim&187 KB (21,006 words) - 22:14, 12 November 2012
- ERROR APER1031: In {file_name} on line {line_number}: Unknown select value \"{select}\".114 bytes (16 words) - 08:32, 28 August 2023
- ...rdbank [http://www.ismal.hi.is/ob/birta/index.cgi at ismal.hi.is] (licence unknown)2 KB (416 words) - 12:31, 17 June 2010
- # Unknown words2 KB (332 words) - 08:10, 8 December 2015
- <element name="unknown"> element unknown { xsd:positiveInteger }4 KB (406 words) - 17:07, 26 May 2011
- ...be able to keep it until transfer in order to be able to substitute things unknown to the bidix.4 KB (715 words) - 22:51, 26 June 2020
- * {{test|hye|տակավին անհայտ է:|It is still unknown.}}17 KB (1,500 words) - 23:50, 4 December 2012
- ERROR APER1051: Unknown input token.62 bytes (8 words) - 08:40, 28 August 2023
- ** Could also help by resolving some unknown words.5 KB (802 words) - 07:04, 10 May 2012
- and a <code>/</code> immediately follows the word. If the word is unknown, <code>*word</code> follows;5 KB (788 words) - 23:14, 17 December 2015
- ValueError: bad marshal data (unknown type code)6 KB (848 words) - 01:44, 23 March 2018
- * Unknown word mark? Analyzer1 KB (220 words) - 14:54, 3 February 2021
- This GDB was configured as "x86_64-unknown-linux-gnu".4 KB (637 words) - 13:57, 16 May 2017
- WARNING APER1167: {arg}: Unknown format {format}, treating as \"txt\".96 bytes (12 words) - 09:55, 28 August 2023
- The analysis of an unknown word is (ignoring the full stop information):10 KB (1,715 words) - 12:29, 28 May 2018
- ...ions. The word is the question, and the possible analyses are the answers. Unknown words can be thought of as questions we don't know what the possible answer4 KB (763 words) - 12:14, 26 September 2016
