[Xapian-discuss] Update under a large database is slow

Gea-Suan Lin gslin at gslin.org
Thu Jul 12 03:18:07 BST 2007


We use Perl module Search::Xapian to index ~4m articles (it's
26GB right now), but updating is slow. (about 4 article/sec with I/O

The articles are UTF-8 CJK, we use bigram to generate terms, so it's
very easy to generate ~10k terms for a mid-size article. The article
itself is not stored in Xapian, but only the terms.

Any suggestion or any detail needed ?

* Gea-Suan Lin  (public key: Using https://keyserver.pgp.com/ to search)
* If you cannot convince them, confuse them.           -- Harry S Truman

More information about the Xapian-discuss mailing list