How to make database build threaded?

Franco Martelli martellif67 at gmail.com
Fri Sep 14 17:09:02 BST 2018


On 14/09/2018 at 09:30, Jean-Francois Dockes wrote:
> Hi,
> 
> You may be interested by how Recoll does it:
> 
> https://www.lesbonscomptes.com/recoll/idxthreads/threadingRecoll.html
> 
> A few things in the document are slightly obsolete (esp. the last
> paragraph: recollindex now does use vfork()), but it's overall quite close
> to how the current indexer works.
> 
> jfd
> 
Thank for your answer, briefly it's No:

> The Xapian library index updating code is not designed for multi-threading and must stay protected from multiple accesses.

just for evaluation purpose could you provide me some links to the code
about how Recoll parallelizes "Data extraction and Conversion" and "Term
generation".
Thanks in advance, best regards

-- 
Franco Martelli



More information about the Xapian-discuss mailing list