[Xapian-devel] Something to think about

[Olly Betts]

On Fri, Oct 12, 2007 at 04:45:13PM +0100, James Aylett wrote:
> Could we have a mechanism where the size of each opened database is
> taken into account, perhaps doubled to provide padding, and if any one
> overflows its padding a new exception is raised? If that were an
> optional strategy, it would work in the majority of cases (could even
> be the default).

Obviously we could, but it wouldn't help in the common case where the
database is opened afresh by each search process.

One approach (rather a long term one) is to allow arbitrary docids -
then searching over multiple databases can simple prefix the docids from
each.  Probably the main challenge there is to maintain the ability to
store them compactly.

Cheers,
    Olly