[Xapian-discuss] PHP indexing, what's the PHP method for indexscript

[athlon athlonf]

I've managed to correctly use PHP-bindings to index my database and I'm really amazed by the speed.

Apparantly, the method of using a perlscript like dbi2omega to get the inputfile and then use scriptindex to parse and index it is much slower.
Indexing with PHP took 9 hours to complete on my developmachine (amd64 3800 with 2GB of ram and 5HDD-raid5) for 3 million documents, with less load.

Indexing with dbi2omega->scriptindex takes more than 24 hours and it's not even at 40% (i've made several intermediate files) at load 5. And this on a AMD dual opteron 246 with raid1 and 3GB of ram.





      ____________________________________________________________________________________
Be a better friend, newshound, and 
know-it-all with Yahoo! Mobile.  Try it now.  http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ