[Xapian-discuss] Suitability of Xapian for my application?

Eric Parusel eparusel at creativens.com
Mon Oct 18 16:38:21 BST 2004


Olly Betts wrote:
>>Apart from the initial import, can I set it so that it fsync's after 
>>each document is inserted (since I process as they come in, rather than 
>>in batches -- and I don't want the updates to be atomic *and* consistent
>>with the inserts to the PostgreSQL db)?
> 
> You can flush every document, though you might find it's too slow to
> keep up with the rate new documents arrive.  The alternative is to
> write a bit of code to recover from a crash by checking which documents
> since the last checkpoint have actually been added.

You wouldn't happen to have done any benchmarks on flushing every 
document, would you?
I *would* be able to re-add documents potentially, I'm just not sure how 
I'd know when the last flush/checkpoint was?

Thanks,
Eric



More information about the Xapian-discuss mailing list