[Xapian-discuss] PHP indexing, what's the PHP method for indexscript

[James Aylett]

On Wed, Jan 16, 2008 at 11:47:14AM -0800, athlon athlonf wrote:

> Actually I'm already graphing my servers, but haven't really
> investigate on the load due to the scriptindex as I was more devving
> atm.

:)

> I've just taken a look and it seems not to be a memory
> problem. During the load spikes, memory went from 20MB to 1GB, but
> there was still 2GB left (albleit cached).

Erm... do you mean that there was 2GB remaining unused by user space
but that it was used by the kernel? You could graph page faults to see
if something isn't doing the right thing there. There shouldn't be a
problem, but there might be something unexpected going on.

> I'd suspect it to be an IO load.

Graph iowait / svcwait times on your disk(s) to get more confidence in
this. You'd need to have something other than scriptindex needing good
access to disk to see those loads (and you'd need the data those
processes need access to not to be cached, of course).

> Hmm... the index=Z... no idea really. A copyandpaste-error i
> think. I remembered that when I delved my first xapian-db, i see
> that "content" which will be searched had the prefix Z, so...

That's to do with stemming, and will be taken care of
automatically. By adding that in, you may get some weird results :-)

J

-- 
/--------------------------------------------------------------------------\
  James Aylett                                                  xapian.org
  james at tartarus.org                               uncertaintydivision.org