[Xapian-devel]Re: [Xapian-commits]7603: trunk/xapian-core/trunk/xapian-core/backends/flint/trunk/xapian-core/backends/quartz/

[Grzegorz Bogdanowicz]

hi,

This is result for one database which have 2G+ files:

C:\xapian>quartzcompact.exe c:\index_en2 f:\index_compact
postlist: INCREASED by -39.1461% 776392K (-1983320K -> -1206928K)
record: Reduced by 47.1947% 5720K (12120K -> 6400K)
termlist: INCREASED by -140.441% 451480K (-321472K -> 130008K)
position: Size unchanged (0K)
value: Size unchanged (0K)


source database:

C:\index_en2>

2007-02-06  09:25    <DIR>          .
2007-02-06  09:25    <DIR>          ..
2007-01-03  16:07                10 meta
2007-01-04  12:18                14 position_baseA
2007-01-04  12:08                14 position_baseB
2007-01-03  16:07                 0 position_DB
2007-01-04  12:18           100 104 postlist_baseA
2007-01-04  12:08            97 939 postlist_baseB
2007-01-04  12:18     6 559 014 912 postlist_DB
2007-01-04  12:18               207 record_baseA
2007-01-04  12:08               181 record_baseB
2007-01-04  12:18        12 410 880 record_DB
2007-01-04  12:18           126 070 termlist_baseA
2007-01-04  12:08           122 906 termlist_baseB
2007-01-04  12:18     8 260 747 264 termlist_DB
2007-01-04  12:18                14 value_baseA
2007-01-04  12:08                14 value_baseB
2007-01-03  16:07                 0 value_DB
              16 plik(ów)     14 832 620 529 bytes
               2 katalog(ów)  43 273 789 440 bytes free


destination database:

F:\index_compact>

2007-02-06  11:42    <DIR>          .
2007-02-06  11:42    <DIR>          ..
2007-02-06  11:42                10 meta
2007-02-06  11:42                13 position_baseA
2007-02-06  11:42                14 position_baseB
2007-02-06  11:42                 0 position_DB
2007-02-06  09:27                13 postlist_baseA
2007-02-06  10:15            46 699 postlist_baseB
2007-02-06  10:15     3 059 073 024 postlist_DB
2007-02-06  10:15                13 record_baseA
2007-02-06  10:15               117 record_baseB
2007-02-06  10:15         6 553 600 record_DB
2007-02-06  10:15                13 termlist_baseA
2007-02-06  11:42            67 589 termlist_baseB
2007-02-06  11:42     4 428 095 488 termlist_DB
2007-02-06  11:42                13 value_baseA
2007-02-06  11:42                14 value_baseB
2007-02-06  11:42                 0 value_DB
              16 plik(ów)      7 493 836 620 bytes
               2 katalog(ów)  335 240 712 192 bytes free

hmm, there are some errors.

best,
     Grzegorz


Dnia 6-02-2007 o godz. 7:57 Olly Betts napisał(a):
> On Wed, Jan 31, 2007 at 10:36:12AM +0100, Grzegorz Bogdanowicz wrote:
> > What kind of result will interessed You?
> > 
> > quartzcheck -> (no errors found)
> > quartzcompact -> (correct compact)
> 
> Thanks for testing.
> 
> The output is probably what's most interesting.  I don't know how stat()
> reacts to a 2GB+ file on Windows (on Unix it fails returning -1 on the
> platforms I've tested).
> 
> If stat fails, quartzcompact will work but won't report the compression
> statistics but will say:
> 
>     Done (couldn't stat all the DB files)
> 
> If stat() returns successfully but with a bogus filesize, then the
> compression statistics will also be bogus.  Seeing the uncompacted
> and compacted filesizes as well as the output from quartzcompact
> might allow us to spot that.
> 
> But I think Charlie's original patch isn't quite correct anyway.
> 
> Cheers,
>     Olly
> 

----------------------------------------------------
Europa Universalis III przeniesie nas w piękne czasy renesansu
epoki wielkich odkryć, wojen religijnych i kształtowania się
współczesnych narodów. Zostań najlepszym strategiem:
http://klik.wp.pl/?adr=http%3A%2F%2Fadv.reklama.wp.pl%2Fas%2Fd64.html&sid=1011