[Xapian-discuss] flush problem

[Jesper Krogh]

Michael A. Lewis wrote:
> I am having a problem with flushing a database. I am adding N records
> to the DB (which amounts to 1 - 2000). At then end of the run, I
> issue a flush() call. The problem is that the flush call never seems
> to do anything. Every 10000 additions to the database and the library
> performs a flush (which can take up to 3 hours on a 560,000 document
> database) as if my flush call was never performed.

Not that I have a solution, but I have a similar problem with my Xapian
database. (doccount 8millions) flushtime is fairly long (over 10 minutes 
on a 16 SAS disk array for 1000 documents added) and monitoring vmstat 
(and top) I can see that it neither saturates 1 cpu or anything near the 
block input/output that the disk can deliver (uses around 5MB/s in 
block/in and out), viewing "top" only around 8-12% IO wait.

All of above is measured when Xapian is "flushing".

Still running xapian 1.0.4 (with perl-bindings)

-- 
Jesper