Details
Description
Build
4.0.0-1655
Consistently reproducible.
Ran locally from my laptop
Testcase and test log : https://friendpaste.com/20tzZfOiFoupw6oy4w40lg
./testrunner -i bixdcr.ini demand_encryption=1 -t xdcr.xdcrMiscTests.XdcrMiscTests.test_diff_version_xdcr,items=10000,doc-ops=create-delete,doc-ops-dest=create-delete,upd=80,del=20,rdirection=bidirection
This testcase tests both capi and xmem.
C1 [.186,.187] --> C2 [.188,.189] , capi replication
C1 [.186,.187] <-- C2 [.188,.189] , xmem replication
does updates and deletes and C1 and C2.
Looks like updates/deletes from C1 do not reach C2.
C1 contains 16000 keys while C2 contains only 8000.
Seeing errors like -
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.189:18092_0:batch update docs failed for vb 683 after 3 retries]
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.189:18092_0:batch update docs failed for vb 557 after 3 retries]
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_1:batch update docs failed for vb 480 after 3 retries]
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 72 after 3 retries]
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 70 after 3 retries]
map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 70 after 3 retries]
Attaching logs. Attaching screenshot of regular metaops spikes on .188.
Do not see any keys stuck on dcp queue on .186. However the outbound mutations value doesn't go down. Screen shot attached.
Note: I'm removing this test from xdcr suite.
Attachments
For Gerrit Dashboard: MB-14092 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
48853,4 | MB-14092 GoXDCR: Dataloss in CAPI replication MB-13291 GoXDCR : Log CAPI post failure return codes 400, 404 with reasons in goxdcr.log Change-Id: Idfbda9073681629301cfaf8b265eff8bbb2065db Reviewed-on: http://review.couchbase.org/48853 Reviewed-by: Yu Sui <ysui68@gmail.com> Tested-by: Xiaomei Zhang <xiaomei@couchbase.com> | master | goxdcr | Status: MERGED | +2 | +1 |