[Xapian-discuss] Xapian performance on gmane.org compared

[Henry]

Thanks for the detailed response, Arjen - see below.

Quoting "Arjen van der Meijden" <acmmailing at tweakers.net>:
> On 27-8-2009 17:34 Henry wrote:
>> [co AND uk] returns double the results, at less than half the speed (15s).
>
> That is actually not very fast, given that the database fits in  
> memory and isn't very large. Although we have a tendency to  
> over-specify our servers, so I actually don't have a very good base  
> of reverence.

The machine is a dual-XEON dual-core, 8GB RAM, RAID1, etc.  Only ~4GB  
available to Xapian, so admittedly not optimal.

> A query like ["windows 7"] took at a good moment 0.7 second, but  
> went up to take up to about 9 seconds with the latest Xapian and a  
> fresh database back in april 2009.

"latest Xapian" == stable 1.0.1[123]? ...or svn?
Using which db format: flint or chert?

> Now it is completed within 0.2 seconds.

Using stable or svn, and which db format?

> But its a bit hard to compare, we replaced the system that is on all  
> fronts much faster and we also reindexed the database on a different  
> file system and with a different compaction block size now.

Can you share details on the file system and compaction block size?

> The average of all returned search-pages went down from about 0.35  
> seconds to 0.18 seconds, and that still includes sending the results  
> internally over the network and doing some processing with those  
> results in the webservers.

Those are good results.  Is this using a single search server - also  
with SSDs?
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: PGP Digital Signature
Url : http://lists.xapian.org/pipermail/xapian-discuss/attachments/20090828/f23bc5d2/attachment.pgp