[Xapian-discuss] Spreading a database across multiple machines

Philip Neustrom philipn at gmail.com
Sun Mar 26 03:01:59 BST 2006


Hey all,

I'm working on a project that contains lots of little sub-sites which
I want to act autonomously.  Right now, each site has its own Xapian
database and when a search is performed this site-specific database is
queried.  I want to be able to have a 'global' search across all of
these said databases.  However, I want the individual site searches to
behave, when searched individually, as if they are the only database. 
It seems like the logical thing to do would be to create a Database
object and then add_database() for each database.  However, I'm
looking at a situation in which there could be thousands of
independent databases, and doing add_database() for each possible site
seems like it could be inefficient in this case.

Is there a way to maintain a single database that can be queried on a
site-specific basis and act like it's a site-specific -- e.g. the
probability/results are weighted according to some site-specific tag? 
(And then if I wanted to divide the master database up due to space
concerns I would do so using add_database(), but it would logically be
one large database).

--Philip Neustrom



More information about the Xapian-discuss mailing list