[Xapian-devel] Something to think about
olly at survex.com
Fri Oct 12 17:27:00 BST 2007
On Fri, Oct 12, 2007 at 04:45:13PM +0100, James Aylett wrote:
> Could we have a mechanism where the size of each opened database is
> taken into account, perhaps doubled to provide padding, and if any one
> overflows its padding a new exception is raised? If that were an
> optional strategy, it would work in the majority of cases (could even
> be the default).
Obviously we could, but it wouldn't help in the common case where the
database is opened afresh by each search process.
One approach (rather a long term one) is to allow arbitrary docids -
then searching over multiple databases can simple prefix the docids from
each. Probably the main challenge there is to maintain the ability to
store them compactly.
More information about the Xapian-devel