[Xapian-devel] Reducing Xapian memory usage
Olly Betts
olly at survex.com
Wed Apr 9 23:33:07 BST 2014
On Wed, Apr 09, 2014 at 12:38:12PM +0100, Olly Betts wrote:
> On Fri, Mar 28, 2014 at 06:03:18PM +0100, Vishesh Handa wrote:
> > 1. Every document has map<string, OmDocumentTerm> and OmDocumentTerm
> > contains the same string again. This results in every term being
> > stored in memory twice. Additionally multiple documents may have the
> > same terms, and each of them would have their own copies to the
> > string, even if the term is the same.
>
> Good spot - it looks like OmDocumentTerm's copy of the term isn't really
> used (just reported in the object description and used in an exception
> message), so we can probably just drop that. I'll commit that change
> when I've had a chance to test it fully.
Now committed to trunk as r17946. I'll make sure it's backported for
1.2.18.
Cheers,
Olly
More information about the Xapian-devel
mailing list