[Xapian-discuss] Suitability of Xapian for my application?
Eric Parusel
eparusel at creativens.com
Mon Oct 18 16:38:21 BST 2004
Olly Betts wrote:
>>Apart from the initial import, can I set it so that it fsync's after
>>each document is inserted (since I process as they come in, rather than
>>in batches -- and I don't want the updates to be atomic *and* consistent
>>with the inserts to the PostgreSQL db)?
>
> You can flush every document, though you might find it's too slow to
> keep up with the rate new documents arrive. The alternative is to
> write a bit of code to recover from a crash by checking which documents
> since the last checkpoint have actually been added.
You wouldn't happen to have done any benchmarks on flushing every
document, would you?
I *would* be able to re-add documents potentially, I'm just not sure how
I'd know when the last flush/checkpoint was?
Thanks,
Eric
More information about the Xapian-discuss
mailing list