[Xapian-tickets] [Xapian] #671: Performance issues when querying over large number of local databases (shards)

[Xapian]

#671: Performance issues when querying over large number of local databases
(shards)
----------------------------------+-----------------------------
 Reporter:  wgreenberg            |             Owner:  olly
     Type:  defect                |            Status:  assigned
 Priority:  normal                |         Milestone:  1.3.4
Component:  Matcher               |           Version:
 Severity:  normal                |        Resolution:
 Keywords:  sharding performance  |        Blocked By:
 Blocking:                        |  Operating System:  Linux
----------------------------------+-----------------------------
Changes (by olly):

 * status:  new => assigned
 * milestone:   => 1.3.4


Comment:

 Actually, the issue with prereading record data is more subtle.  The
 current mechanism uses the same mechanism to read in advance as to read
 live, which is fine for remote backend prereading, but for a local
 database I can't see it being useful to do the preread and then actually
 read.

 I've committed the patch with a couple more tweaks in
 [b904d0e5ae9a1fca9ca0bd1bbe5fe670d3ce1431], with a FIXME comment to sort
 out the record case.  It should work as it is, there's just a pointless
 preread call when reading a document from the MSet.

 That shouldn't be too hard to resolve, and it'd be good to sort out before
 1.3.4 so setting the milestone to that.

--
Ticket URL: <http://trac.xapian.org/ticket/671#comment:15>
Xapian <http://xapian.org/>
Xapian