[Xapian-discuss] Unexpected slowness

[Daniel Andersson]

On 5 Feb 2007, at 20:17, Olly Betts wrote:

> On Thu, Jan 25, 2007 at 10:02:59PM +0200, Daniel Andersson wrote:
>> On both the development machines the searches run as fast as expected
>> but on the live machine (Linux 2.4.22) the searches take seconds (2-7
>> seconds). And the live machine is much faster than the devel  
>> machines.
>
> What do you mean by "faster"?  Raw CPU speed isn't usually the  
> limiting
> factor for a large database - does it have at least as much RAM and a
> disk subsystem which as at least as fast?

faster as in faster cpu, faster disks and faster memory
but it only has 1 gb of ram
it's running on megaraid with scsi-disks. from bonnie++:

Version  1.03       ------Sequential Output------ --Sequential Input-  
--Random-
                     -Per Chr- --Block-- -Rewrite- -Per Chr- -- 
Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec % 
CP  /sec %CP
septum           2G 14061  54 14601   5  3258   0  5026  16  4289   0  
219.7   0
                     ------Sequential Create------ --------Random  
Create--------
                     -Create-- --Read--- -Delete-- -Create-- -- 
Read--- -Delete--
               files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec % 
CP  /sec %CP
                  16 12837  44 +++++ +++ 14069  57 14783  55 +++++ ++ 
+ 12375  59
septum,2G,14061,54,14601,5,3258,0,5026,16,4289,0,219.7,0,16,12837,44,+ 
++++,+++,14069,57,14783,55,+++++,+++,12375,59


> Also, is the live machine doing a lot of other work?

have tried searches on multiple occasions, both when the machine was  
under load and when it was not. still slow..


> What does "ls -l sub_index_0" show?

$ ls -l sub_index_0/
total 1750116
-rw-r--r--    1 tt       users          10 Jan 23 15:10 meta
-rw-r--r--    1 tt       users    65929216 Jan 24 14:48 position_DB
-rw-r--r--    1 tt       users        1019 Jan 24 11:59 position_baseA
-rw-r--r--    1 tt       users        1020 Jan 24 14:48 position_baseB
-rw-r--r--    1 tt       users    1264721920 Jan 24 14:47 postlist_DB
-rw-r--r--    1 tt       users       19319 Jan 24 11:59 postlist_baseA
-rw-r--r--    1 tt       users       19319 Jan 24 14:48 postlist_baseB
-rw-r--r--    1 tt       users    38207488 Jan 24 14:48 record_DB
-rw-r--r--    1 tt       users         600 Jan 24 11:59 record_baseA
-rw-r--r--    1 tt       users         600 Jan 24 14:48 record_baseB
-rw-r--r--    1 tt       users    410992640 Jan 24 14:48 termlist_DB
-rw-r--r--    1 tt       users        6290 Jan 24 11:59 termlist_baseA
-rw-r--r--    1 tt       users        6290 Jan 24 14:48 termlist_baseB
-rw-r--r--    1 tt       users    12181504 Jan 24 14:48 value_DB
-rw-r--r--    1 tt       users         203 Jan 24 11:59 value_baseA
-rw-r--r--    1 tt       users         203 Jan 24 14:48 value_baseB

thanks again!

cheers,
daniel