[Xapian-discuss] xapian performance

[Arjen van der Meijden]

On 21-11-2006 12:45 Olly Betts wrote:
> You need 0.9.9 with the 2 other patches from this thread applied to search
> the updated database (it has a new flint revision).  Then you'll be able
> to compare timings of 0.9.9 (possibly plus earlier patches) against the
> original database compared to the fully patched 0.9.9 against the
> updated one!

Ok, I've attached two text files. I took a list of queries to counter 
caching playing a part in the results. These results didn't change much 
over time in either case so it really should be the patches doing their 
jobs.

The first file (no-patch) contains the results (the 3rd in three runs) 
with no patches at all. And the second the results of all the patches 
from this thread and the converted database.
I see no cases of slower queries, and some are even 30-40% faster.

Note that the timings are seconds and include omega's (neglicable) 
start-up time, so there are queries that take 3+ minutes on my "normal 
desktop hardware"-test machine (2GB of memory and a single disk). On the 
production server (8GB, 5+1-disk raid5) these were also some of the 
slower queries, taking 5-20 or more seconds.

If you're interested I can also execute the same queries with your 
display-blocks-read patch, but that'll have to wait untill next week.

Best regards,

Arjen
-------------- next part --------------
Query: c-media ac97 audio device
43,789s taken

Query: "ie 7"
215,951s taken

Query: @live.nl
76,097s taken

Query: "help and support" vista
69,508s taken

Query: x-mod
139,372s taken

Query: geluidskaarten 5.1
169,703s taken

Query: i-mate spl
87,998s taken

Query: pc verbinden telefoon bluetooth foto's
151,073s taken

Query: 5:3
204,545s taken

Query: "listen to believe"
13,277s taken

Query: user/user
199,699s taken

Query: suse 10.0
114,806s taken

Query: config/system
97,612s taken

Query: "windows desktop search"
40,388s taken

Query: ati "spanning mode"
41,216s taken

Query: hermes 1.06
84,141s taken

Query: on-board stekker
59,038s taken

Query: extra balk in firefox 2.0
111,897s taken

Query: tcp/ip
83,258s taken

Query: tv-out fa
48,805s taken

Query: nrc next "in het midden"
177,575s taken

Query: 5.1 avi
106,808s taken

Query: verschil tussen pci-x en pci 64
74,693s taken

Query: asp.net cache
119,151s taken

Query: goede tv-out kaart
120,988s taken

Query: windows kan bestand hal.dll niet vinden
38,692s taken

Query: lian-li
11,547s taken

Query: kan geen http-verbinding maken
162,518s taken

Query: "als platte tekst en html verzenden"
24,667s taken

Query: i/o programeren
48,974s taken

Query: "windows me" resolutie
192,251s taken

-------------- next part --------------
Query: c-media ac97 audio device
40,184s taken

Query: "ie 7"
161,083s taken

Query: @live.nl
62,604s taken

Query: "help and support" vista
58,846s taken

Query: x-mod
108,017s taken

Query: geluidskaarten 5.1
126,837s taken

Query: i-mate spl
68,754s taken

Query: pc verbinden telefoon bluetooth foto's
105,017s taken

Query: 5:3
159,149s taken

Query: "listen to believe"
10,361s taken

Query: user/user
150,226s taken

Query: suse 10.0
83,918s taken

Query: config/system
78,934s taken

Query: "windows desktop search"
33,136s taken

Query: ati "spanning mode"
36,941s taken

Query: hermes 1.06
59,295s taken

Query: on-board stekker
52,055s taken

Query: extra balk in firefox 2.0
90,156s taken

Query: tcp/ip
64,619s taken

Query: tv-out fa
36,696s taken

Query: nrc next "in het midden"
141,958s taken

Query: 5.1 avi
81,263s taken

Query: verschil tussen pci-x en pci 64
64,488s taken

Query: asp.net cache
93,955s taken

Query: goede tv-out kaart
79,670s taken

Query: windows kan bestand hal.dll niet vinden
35,853s taken

Query: lian-li
10,366s taken

Query: kan geen http-verbinding maken
125,051s taken

Query: "als platte tekst en html verzenden"
16,891s taken

Query: i/o programeren
39,356s taken

Query: "windows me" resolutie
148,218s taken