[Xapian-discuss] Tika memory problems. Omindex restrictions?

[Olly Betts]

On Sat, Jun 18, 2011 at 08:23:28PM +0530, Charles wrote:
> Taking a sample of failing Tika commands from omindex output and running
> them at the command prompt does not produce any errors.  It is beginning
> to look as if the problem is caused by the environment that omindex sets
> up for Tika to run in.  Does that make any sense?

To prevent issues with run-away filters, they're limited to the size of
physical memory and 5 minutes of CPU time.

If Tika's really using > 1GB of memory to extract files under 1MB, it
seems that's going to be problematic on a system with 1GB of memory.

What Xapian version are you using?  Older versions of Omega based
bug which based the limit on free memory, which on Linux excludes
that used for caching, often leaving a very small amount of memory
apparently free.

Cheers,
    Olly