[Xapian-discuss] Optimization and Load balancing with Xapian

[Arjen van der Meijden]

For our set-up I ran some tests and noticed the sorted-by-value runs 
were indeed a slower, but not as dramatic as yours. It varied from 2 to 
8 times as slow (the time Omega reports) than the non-value sorted 
search. The query 'cpu ram' (wdf resp 80108 and 62900) took 0.107 
seconds in relevance-sorting and 0.336 when sorting on a date.

Of course our hardware is (likely) much faster than yours, but our 
database is larger too (1.1M documents and 12GB on disk in compacted 
flint). Are these the initial runs for those queries, or did you rerun 
the tests a few times, i.e. its unfair to compare a non-cached 
value-sorted run to a (then) cached relevance-sorted run.

Best regards,

Arjen

David Levy wrote:
> Ok for the directory :)
> 
> Here are some results :
> 
> (time /usr/local/lib/omega/bin/omega DB=products P=xxxxxxx SORT=3)
> 
> test paris
> real    0m5.130s
> user    0m0.035s
> sys     0m0.039s
> 
> paris france
> real    0m19.902s
> user    0m0.049s
> sys     0m0.116s
> 
> new york
> real    4m10.437s
> user    0m0.459s
> sys     0m1.601s
> 
> !!!!!!!!!!!!!!!!!!!!!!!!
> 
> that's crazy :)
> 
> maybe because today i don't hae many available RAM (i use most of my RAM 
> to test RAMDISK for xapian on this server)
> 
> what should i see with this figures ?
> 
> regards
> 
> 
> On 2/24/06, *Olly Betts* <olly at survex.com <mailto:olly at survex.com>> wrote:
> 
>     On Fri, Feb 24, 2006 at 02:35:46PM +0200, David Levy wrote:
>      > Yes, I always use Omega PHP5 bindings were not available.
>      > Do you think it would be faster with 0.9.3 + php5 bindings ??
> 
>     I'd be suprised if it was.
> 
>      > Thanks for the command, but I can't make it work. In which
>     directory should
>      > I execute it ?
>      > Here is the error :
>      >
>      > $ time /usr/local/lib/omega/bin/omega DB=products P='test query'
>     SORT=1
>      > Content-Type: text/html
>      >
>      > Exception: Couldn't read format template `query' (No such file or
>     directory)
> 
>     Where is your omega.conf file?  Where are the omegascript templates?
> 
>     Cheers,
>         Olly
> 
> 
> 
> 
> -- 
> David LEVY {selenium}
> Website ~ http://www.davidlevy.org
> Wishlist Zlio ~ http://david.zlio.com/wishlist 
> <http://david.zlio.com/wishlist>
> Blog ~ http://selenium.blogspot.com
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Xapian-discuss mailing list
> Xapian-discuss at lists.xapian.org
> http://lists.xapian.org/mailman/listinfo/xapian-discuss