[Xapian-devel] Reducing Xapian memory usage

Olly Betts olly at survex.com
Wed Apr 9 23:33:07 BST 2014


On Wed, Apr 09, 2014 at 12:38:12PM +0100, Olly Betts wrote:
> On Fri, Mar 28, 2014 at 06:03:18PM +0100, Vishesh Handa wrote:
> > 1. Every document has map<string, OmDocumentTerm> and OmDocumentTerm
> > contains the same string again. This results in every term being
> > stored in memory twice. Additionally multiple documents may have the
> > same terms, and each of them would have their own copies to the
> > string, even if the term is the same.
> 
> Good spot - it looks like OmDocumentTerm's copy of the term isn't really
> used (just reported in the object description and used in an exception
> message), so we can probably just drop that.  I'll commit that change
> when I've had a chance to test it fully.

Now committed to trunk as r17946.  I'll make sure it's backported for
1.2.18.

Cheers,
    Olly



More information about the Xapian-devel mailing list