Database corruption after clean rebuild

[David Bremner]

Javier Garcia <javiertury at gmail.com> writes:

> I've applied the path to notmuch 0.26.1 without success.
>
> $ rm -rf ~/.mail/.notmuch
> $ LD_LIBRARY_PATH=/hidden-path/notmuch-0.26.1/lib/:$LD_LIBRARY_PATH
> ./notmuch new
>    Found 20065 total files (that's not much mail).
>    Processed 20065 total files in 58s (341 files/sec.).
>    Added 19605 new messages to the database.
>
> $ xapian-check .mail/.notmuch/xapian/
>    docdata:
>    blocksize=8K items=63 firstunused=1 revision=2 levels=0 root=0
>    B-tree checked okay
>    docdata table structure checked OK
>    termlist:
>    blocksize=8K items=43520 firstunused=8293 revision=2 levels=2 root=748
>    xapian-check: DatabaseError: 1 unused block(s) missing from the free
> list, first is 0

OK, so probably not related to reference loops (although that patch is
not very well tested).  It's not clear how notmuch is triggering it, but
this looks like the same bug in Xapian that olly fixed recently [1].

A possible next step is to try building xapian master, and linking
notmuch against that.

Maybe Patrick or Justus (in copy) has some idea why you're only seeing
problems in afew.

Another debugging direction is to try to duplicate your problem with
some subset of mail that you're willing to share (bisection is the usual
strategy).

[1] https://notmuchmail.org/pipermail/notmuch/2018/026369.html