Ticket #37: pyndexter-xapian.diff

File pyndexter-xapian.diff, 0.6 kB (added by Dirk Datzert <dummy@habmalnefrage.de>, 2 years ago)
Patch for xapian-indexer to chek the word length

pyndexter-0.2/pyndexter/indexers/xapian.py

old	new
48	48
49	49	doc.add_term('Q' + uri)
50	50
	51	FLINT_BTREE_MAX_KEY_LEN = 240
	52
51	53	for word in self.words.finditer(content):
52	54	term = self.stemmer.stem_word(word.group().lower())
	55	if len(term) > FLINT_BTREE_MAX_KEY_LEN:
	56	continue
53	57	doc.add_posting(term, word.start())
54	58
55	59	self.db.replace_document('Q' + uri, doc)