[Xapian-discuss] Possible configurations

[Olly Betts]

On Mon, Sep 11, 2006 at 09:59:46AM -0700, Eric Theise wrote:
> One option seems to be to crawl our sites with htdig, keeping all indexes on
> a master server.  I'm setting up a system using htdig2omega this morning,
> but at first glance, it seems as if we'd lose the ability to do incremental
> updates this way.

Using htdig2omega probably doesn't lend itself to incremental updates
especially well.

Since you run all these sites, perhaps the simplest way to index
centrally is to rsync the sites (over ssh probably) to a set of mirrored
document trees on a server which handles the search.  Just run rsync
right before you try to do an incremental update (and if rsync reports
no changes, you can shortcut and not run the update).

> I also wonder if flint is the predominant database format these days, or if
> there are reasons to stay with quartz.

I'd probably recommend using the current incarnation of flint at this
point.  My current thoughts are to make the current state of flint the
default backend for 1.0, and then continue development on a branched
copy.  The hardest part is what to name things...

Cheers,
    Olly