[Xapian-tickets] [Xapian] #348: Compress replication changesets

[Xapian]

#348: Compress replication changesets
---------------------------+------------------------------------------------
 Reporter:  olly           |       Owner:  olly     
     Type:  defect         |      Status:  new      
 Priority:  normal         |   Milestone:  1.1.1    
Component:  Backend-Chert  |     Version:  SVN trunk
 Severity:  normal         |   Blockedby:           
 Platform:  All            |    Blocking:           
---------------------------+------------------------------------------------
 We should probably compress changesets for replication with zlib as we
 store to disk and uncompress after they've been sent over the network.

 Advantages are that replication would need much less disk space and
 network bandwidth.  Disadvantage is a bit more CPU needed.

 My feeling is that it's probably best to always do it though (at least
 until we have a backend which produces less compressible blocks) as
 replication is likely to be I/O bound.  We can always use the equivalent
 of {{{gzip -1}}} to trade speed/space.

 Setting milestone:1.1.1 for now - I'm currently intending to mark
 replication as "experimental" for 1.1.0.

-- 
Ticket URL: <http://trac.xapian.org/ticket/348>
Xapian <http://xapian.org/>
Xapian