[Xapian-discuss] Threaded test (in C++) to reproduce our database problems

Eric B. Ridge ebr@tcdi.com
Thu, 17 Jun 2004 00:30:50 -0400


> This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

--B_3170277052_25820478
Content-type: text/plain;
	charset="US-ASCII"
Content-transfer-encoding: 7bit

>> Writer:  ERROR=Db block overwritten
> 
> But the writer thread shouldn't get this unless there's another writer.

Did you mean "writer to the same database" or "writer to ANY database"???

I've hacked up the C++ thread test to do this:

- 2 Writer threads.  Each to a *different* database
- ZERO! reader threads.

In theory, these guys should not interfere with each other, right?  Or am I
clueless here too?

Check this out:

----------------------------
$ rm -rf /tmp/*.db && build/xapian_threads
Opening /tmp/one.db
Opening /tmp/two.db
Writer /tmp/one.db: flush()
Writer /tmp/two.db: flush()
<repeats a bunch of times>
Writer /tmp/one.db: flush()
Writer /tmp/two.db: flush()
Writer /tmp/one.db: flush()
Writer /tmp/two.db: ERROR=Db block overwritten
Writer /tmp/two.db thread unexpectedly exited...
Writer /tmp/one.db: ERROR=Error reading block 44: got end of file
Writer /tmp/one.db thread unexpectedly exited...
-----------------------------

Explain this one.  ;)  Now I'm really stumped.  Can't write to two separate
databases at a time?  Hmm...

eric


--B_3170277052_25820478
Content-type: application/octet-stream; name="xapian_threads.cpp"
Content-disposition: attachment;
	filename="xapian_threads.cpp"
Content-transfer-encoding: base64

I2luY2x1ZGUgPHhhcGlhbi5oPgojaW5jbHVkZSA8cHRocmVhZC5oPgojaW5jbHVkZSA8dW5p
c3RkLmg+CiNpbmNsdWRlIDxpb3N0cmVhbT4KI2luY2x1ZGUgInhhcGlhbl90aHJlYWRzLmgi
Cgp1c2luZyBuYW1lc3BhY2Ugc3RkOwoKcHRocmVhZF90IF93cml0ZXIxLCBfd3JpdGVyMjsK
CnZvaWQgZG9fd3JpdGVzKGNoYXIgKmRicGF0aCkgewoJY291dCA8PCAiT3BlbmluZyAiIDw8
IGRicGF0aCA8PCBlbmRsOwoJWGFwaWFuOjpXcml0YWJsZURhdGFiYXNlIGRiID0gWGFwaWFu
OjpBdXRvOjpvcGVuKGRicGF0aCwgWGFwaWFuOjpEQl9DUkVBVEVfT1JfT1ZFUldSSVRFKTsK
CWNoYXIgKnJuZCA9IChjaGFyICopIG1hbGxvYygyNTUpOwoJbWVtc2V0KHJuZCwgMCwgMjU1
KTsKCQoJdHJ5IHsKCQkvLyBlbmRsZXNzbHkgYWRkIGEgMjAwMCB0ZXJtIGRvY3VtZW50IHRv
IHRoZSBkYXRhYmFzZQoJCXdoaWxlICh0cnVlKSB7CgkJCVhhcGlhbjo6RG9jdW1lbnQgZG9j
OwoJCQlpbnQgaT0wOwoKCQkJZm9yICg7IGk8MTAwMDsgaSsrKSB7CgkJCQlkb2MuYWRkX3Bv
c3RpbmcoInJhbmRvbSIsIGkpOwoKCQkJCXNwcmludGYocm5kLCAiJWQiLCByYW5kKCkpOwoJ
CQkJZG9jLmFkZF9wb3N0aW5nKHJuZCwgaSk7CgkJCX0KCQkKCQkJZGIuYWRkX2RvY3VtZW50
KGRvYyk7CgkJCQoJCQkvLyBmbHVzaCBldmVyeSBkb2N1bWVudAoJCQlkYi5mbHVzaCgpOwoJ
CQljb3V0IDw8ICJXcml0ZXIgIiA8PCBkYnBhdGggPDwgIjogZmx1c2goKSIgPDwgZW5kbDsK
CQl9Cgl9IGNhdGNoIChYYXBpYW46OkVycm9yICZlcnIpIHsKCQljZXJyIDw8ICJXcml0ZXIg
IiA8PCBkYnBhdGggPDwgIjogRVJST1I9IiA8PCBlcnIuZ2V0X21zZygpIDw8IGVuZGw7Cgl9
CgljZXJyIDw8ICJXcml0ZXIgIiA8PCBkYnBhdGggPDwgIiB0aHJlYWQgdW5leHBlY3RlZGx5
IGV4aXRlZC4uLiIgPDwgZW5kbDsKCXB0aHJlYWRfZXhpdChOVUxMKTsKfQoKdm9pZCBzZXR1
cF93cml0ZXJfdGhyZWFkKHB0aHJlYWRfdCAqdGhyZWFkLCBjaGFyICpkYnBhdGgpIHsKCXB0
aHJlYWRfY3JlYXRlKHRocmVhZCwgTlVMTCwgZG9fd3JpdGVzLCBkYnBhdGgpOwp9CgppbnQg
bWFpbihpbnQgYXJndiwgY2hhciAqKmFyZ2MpIHsKCXNldHVwX3dyaXRlcl90aHJlYWQoJl93
cml0ZXIxLCAiL3RtcC9vbmUuZGIiKTsKCXNldHVwX3dyaXRlcl90aHJlYWQoJl93cml0ZXIy
LCAiL3RtcC90d28uZGIiKTsKCgkvLyBzaXQgYW5kIHdhaXQgZm9yIGV2ZXJ5dGhpbmcgdG8g
ZmluaXNoCgkvLyBpbiBhIHBlcmZlY3Qgd29ybGQsIHRoZXknbGwgbmV2ZXIgZmluaXNoCglw
dGhyZWFkX2pvaW4oX3dyaXRlcjEsIE5VTEwpOwkKCXB0aHJlYWRfam9pbihfd3JpdGVyMiwg
TlVMTCk7CQoJcmV0dXJuIDA7Cn0KCg==

--B_3170277052_25820478--