[Xapian-discuss] omindex killed

[Chris Purves]

On 29/12/2012 11:07 AM, Jim Lynch wrote:
> On 12/29/2012 09:26 AM, Rob Nagler wrote:
>> You can run it with "/usr/bin/time omindex ...." to see what resources
>> are being consumed before it is killed.
>>
>> I'm assuming this runs a long time.  If it is a short time, you might
>> be running out of memory.
>>
> If you can, bring up gnome-system-monitor while it's running.  You can
> see memory and cpu usage in real-time.

time crashes along with omindex, so I wasn't able to get much 
information there.

If I run top while omindex is running, I can see that CPU usage is high, 
but not a problem, the load average is about 2.  Memory usage continues 
increasing over time.  Eventually physical memory is used up.  It seems 
that once we start using the swap, the pdf conversion begins failing. 
When the swap is exhausted, omindex crashes.

I have 2 GB of RAM and 1 GB of swap.  The RAM is mostly accessible when 
I begin (1.7 GB).  The problem directory contains many about 400 
sub-directories with very large text files ~ 2.5 MB.


-- 
Chris Purves
Visit my blog: http://chris.northfolk.ca

"Canada's like a loft apartment over a really great party.  Keep it 
down, eh!" - Robin Williams