Concordancer - Revision history

Shardulc: GitHub migration

2018-03-10T02:11:11Z

GitHub migration

Francis Tyers: /* TODO */

2013-11-30T15:36:29Z

TODO

Francis Tyers: /* External links */

2013-11-28T00:45:22Z

External links

Francis Tyers at 00:43, 28 November 2013

2013-11-28T00:43:59Z

Sushain: add proposed changes and interface pictures

2013-11-27T21:26:42Z

add proposed changes and interface pictures

Sushain at 20:37, 27 November 2013

2013-11-27T20:37:52Z

Sushain at 20:35, 27 November 2013

2013-11-27T20:35:23Z

Sushain at 20:34, 27 November 2013

2013-11-27T20:34:28Z

Sushain: add web concordancer section

2013-11-27T20:34:04Z

add web concordancer section

Francis Tyers: Created page with " A '''concordancer''' is a tool which shows you a word, in context. ==External links== * [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer webcon..."

2013-11-27T20:02:41Z

Created page with " A '''concordancer''' is a tool which shows you a word, in context. ==External links== * [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer webcon..."

New page

A '''concordancer''' is a tool which shows you a word, in context.

==External links==

* [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer webconcordancer]
* [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer/originalConcordancer.py simple python-based concordancer]

[[Category:Tools]]

@@ Line 1: / Line 1: @@
+{{Github-unmigrated-tool}}
 {{TOCD}}
 A '''concordancer''' is a tool which shows you a word, in context.

@@ Line 45: / Line 45: @@
 * Efficiency: Make it scale up to corpora of millions of words. This might involve doing (a) pre-analysis of the corpus -- e.g. the program doesn't read + analyse, but rather just read from a pre-analysed corpus; and (b) indexing using SQLite or something similar.
+* Pagination: Limit results to ''n'' per page, perhaps 10,50,100,500,all
 ==External links==

@@ Line 41: / Line 41: @@
 [[File:concordancerProposed.png|600px]]
+==TODO==
+* Efficiency: Make it scale up to corpora of millions of words. This might involve doing (a) pre-analysis of the corpus -- e.g. the program doesn't read + analyse, but rather just read from a pre-analysed corpus; and (b) indexing using SQLite or something similar.
 ==External links==

← Older revision		Revision as of 00:43, 28 November 2013
Line 1:		Line 1:
			{{TOCD}}

	A '''concordancer''' is a tool which shows you a word, in context.		A '''concordancer''' is a tool which shows you a word, in context.

@@ Line 28: / Line 28: @@
 #* e.g. <code>previous</code> will find all the instances of the letter sequence 'previous' in the corpus
 #* e.g. <code>\.$</code> will find all the instances of a period character ending a line in the corpus
+=== Current Interface ===
+[[File:concordancer.png|600px]]
+=== Proposed Changes ===
+# Apply an unlimited number of sets of filters simultaneously.
+# To appear in the output, a line of the corpus must have tokens which fulfill all the sets of filters specified.
+# Filters can be added one by one and deleted
+=== Proposed Interface (draft) ===
+[[File:concordancerProposed.png|600px]]
 ==External links==

@@ Line 5: / Line 5: @@
 A concordancer web interface is available in the SVN at [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer /trunk/apertium-tools/webconcordancer]. Use <code>python3 server.py</code> to run the code on <code>localhost:8080/concordancer.html</code>. The web interface requires three primary inputs to set up:
-# Corpus path: an absolute path to the the corpus (e.g. /home/apertium/Desktop/corpus.txt)
+# '''Corpus path''': an absolute path to the the corpus (e.g. /home/apertium/Desktop/corpus.txt)
-# Language module: an absolute path to the language module to use for analysis (e.g. /home/apertium/Desktop/apertium-en-es)
+# '''Language module''': an absolute path to the language module to use for analysis (e.g. /home/apertium/Desktop/apertium-en-es)
-# Language Pair: the language pair to pass to Apertium for morphological analysis (e.g. en-es-anmor)
+# '''Language Pair''': the language pair to pass to Apertium for morphological analysis (e.g. en-es-anmor)
-# Search Window: the size of the context around the token located in number of characters/number of tokens (e.g. 15)
+# '''Search Window''': the size of the context around the token located in number of characters/number of tokens (e.g. 15)
 The interface also supports four distinct search modes, each of which has support for regular expressions (enabled via a checkbox):

@@ Line 18: / Line 18: @@
 # '''Lemma Search''': this mode will output all tokens in the corpus which contain lemmas that match the given search string and supports regex within the search string (omit the regex '$' token)
-#* e.g. <code>be</code> will show all the tokens that are forms of the verb 'be'
+#* e.g. <code>be</code> will show all the tokens that are forms of the word 'be'
 #* e.g. <code>t.*</code> will show all the tokens that have lemmas beginning with 't'

@@ Line 3: / Line 3: @@
 ==Web Concordancer==
-A concordancer web interface is available in the SVN at [[https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer /trunk/apertium-tools/webconcordancer]. Run <code>python3 server.py</code> to run the code on <code>localhost:8080/concordancer.html</code>. The web interface requires three primary inputs to set up:
+A concordancer web interface is available in the SVN at [https://svn.code.sf.net/p/apertium/svn/trunk/apertium-tools/webconcordancer /trunk/apertium-tools/webconcordancer]. Use <code>python3 server.py</code> to run the code on <code>localhost:8080/concordancer.html</code>. The web interface requires three primary inputs to set up:
 # Corpus path: an absolute path to the the corpus (e.g. /home/apertium/Desktop/corpus.txt)