[Xapian-discuss] Xapian performance and xapian-python

[Patrick Oliver Glauner]

> Are these warm cache or cold cache times?
Warm cache times.

>Does the patch here help: http://trac.xapian.org/ticket/394
We installed it, but there is no significant change. Next, we are profiling it to get a better understanding of the issue and then we will get back to you.


But I would like to refer to my original third question which is really important for us:
> Question 3
>How come that the Xapian time consumption is almost independent from RANKED_RESULT_AMOUNT?
> If I increase it to 10000, the wall time is still nearly the same.

%time matches = enquire.get_mset(0, RANKED_RESULT_AMOUNT)

Is this the way Xapian is supposed to behave? In most of our use cases RANKED_RESULT_AMOUNT is quite small (<100) and we need to get these ranked results as fast as possible.

Thanks
Patrick



________________________________________
From: Olly Betts [olly at survex.com]
Sent: Monday, June 25, 2012 1:12 PM
To: Patrick Oliver Glauner
Cc: xapian-discuss at lists.xapian.org
Subject: Re: [Xapian-discuss] Xapian performance and xapian-python

On Mon, Jun 25, 2012 at 08:30:10AM +0000, Patrick Oliver Glauner wrote:
> The output is:
> CPU times: user 1.82 s, sys: 2.16 s, total: 3.99 s
> Wall time: 1.99 s
>
> Querying an equivalent Solr instances is much faster:
> CPU times: user 0.34 s, sys: 0.00 s, total: 0.34 s
> Wall time: 0.21 s

Are these warm cache or cold cache times?

> Question 4
> How can I improve Xapian performance? Are there any configuration
> parameters I can use?

Does the patch here help:

http://trac.xapian.org/ticket/394

Cheers,
    Olly