[Xapian-discuss] How to avoid storing duplicate documents?
Jarrod Roberson
jarrod at vertigrated.com
Tue Nov 3 04:11:31 GMT 2009
On Mon, Nov 2, 2009 at 9:01 PM, 岳帅杰 <ysj.ray at gmail.com> wrote:
>
> When I index many documents, I don't want to store duplicate documents.
> How can I detect whether a same document has been stored in database and
> then discard it?
> Or is there a function that xapian can automatically detect it and avoid
> storing duplicate ducuments?
>
> 2009-11-03
>
If you have a unique KEY/ID you can add to each document then you can look
up that key and if it found don't re-add the document.
--
Jarrod Roberson
678.551.2852
More information about the Xapian-discuss
mailing list