[Xapian-discuss] Improving indexing speed

[Olly Betts]

On Mon, Jun 30, 2008 at 11:07:19PM -0700, Robert Kaye wrote:
> However, given a sufficiently beefy machine, I think I could use  
> multiple cores to get this job done in a hurry. Given the memory use/ 
> disk IO trade-off I've observed, I think I could have my indexing  
> machine, run 2-4 indexers if I dedicated all 8G of RAM to the task. :)  
> Performance improves drastically when you give Xapian 500-700MB of RAM  
> to play with. About 1.5G per process would probably result in a well  
> loaded machine -- I'm guessing.
> 
> Would anyone be interested in the results of this? I've got these 8  
> core/8G machines sitting in my office, waiting to go to the colo and I  
> could try it out. (Not that I would do this in a production  
> environment -- I'm not that pressed for time)

Yes, it's always interesting to hear performance reports.

Cheers,
    Olly