zeitgeist team mailing list archive

[David Barth <david.barth@xxxxxxxxxxxxx>]

David Barth has proposed merging lp:~dbarth/zeitgeist-extensions/fts-cjk-support into lp:zeitgeist-extensions.

Requested reviews:
  Zeitgeist Extensions (zeitgeist-extensions)

For more details, see:
https://code.launchpad.net/~dbarth/zeitgeist-extensions/fts-cjk-support/+merge/72903

Add support for the new CJK tokenizer in Xapian
-- 
https://code.launchpad.net/~dbarth/zeitgeist-extensions/fts-cjk-support/+merge/72903
Your team Zeitgeist Extensions is requested to review the proposed merge of lp:~dbarth/zeitgeist-extensions/fts-cjk-support into lp:zeitgeist-extensions.

=== modified file 'fts/fts.py'
--- fts/fts.py	2011-07-04 10:25:10 +0000
+++ fts/fts.py	2011-08-25 14:09:57 +0000
@@ -176,6 +176,9 @@
 	
 	def __init__ (self, engine):
 		self._engine = engine
+
+		# Activate support for the CJK tokenizer
+		os.environ['XAPIAN_CJK_NGRAM'] = '1'
 	
 		log.debug("Opening full text index: %s" % INDEX_FILE)
 		self._index = xapian.WritableDatabase(INDEX_FILE, xapian.DB_CREATE_OR_OPEN)