Details
-
Bug
-
Resolution: Fixed
-
Critical
-
6.5.0
-
Triaged
-
-
Unknown
-
KV-Engine MH 2nd Beta, KV-Engine Mad-Hatter GA
Description
Build : 6.5.0-4380
Test : -test tests/rebalance/test_allRebalance_durability.yml -scope tests/rebalance/scope_rebalanceBase_durability.yml
Scale : 2
On nodes 172.23.104.17, the following type of errors are seen in the memcached logs.
2019-10-01T13:21:30.180391-07:00 INFO 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:789) Attempting to add takeover stream: opaque_:47, start_seqno_:75780, end_seqno_:18446744073709551615, vb_uuid:266534241399010, snap_start_seqno_:75780, snap_end_seqno_:75780, last_seqno:75780, stream_req_value:{"uid":"0"}
|
2019-10-01T13:21:30.189889-07:00 ERROR 108: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f91fd868e10","ewouldblock":false,"packet":{"bodylen":40,"cas":1569961289254109184,"datatype":"raw","extlen":21,"key":"<ud>.BEBD9644-40_111979</ud>","keylen":19,"magic":"ClientRequest","opaque":47,"opcode":"DCP_DELETION","vbucket":789},"refcount":1}] - closing connection ([ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): PassiveDurabilityMonitor::completeSyncWrite vb:789 No Prepare waiting for completion, but received commit for key <ud>cid:0x0:BEBD9644-40_111979</ud>
|
2019-10-01T13:21:30.190005-07:00 INFO 108: (No Engine) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - Removing connection [ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]
|
2019-10-01T13:21:30.190041-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:789) Setting stream to dead state, last_seqno is 75786, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
|
2019-10-01T13:21:30.190079-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:779) Setting stream to dead state, last_seqno is 76067, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
|
2019-10-01T13:21:30.190096-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:780) Setting stream to dead state, last_seqno is 76081, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
|
2019-10-01T13:21:30.190109-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:787) Setting stream to dead state, last_seqno is 75932, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
|
2019-10-01T13:21:30.190124-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:781) Setting stream to dead state, last_seqno is 75950, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
|
2019-10-01T13:21:30.480689-07:00 INFO 102: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.19->ns_1@172.23.104.17:other-1 - (vb:446) Setting stream to dead state, last_seqno is 76047, unAckedBytes is 0, status is The stream closed due to a close stream message
|
2019-10-01T13:21:30.480831-07:00 INFO 102: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.19->ns_1@172.23.104.17:other-1 - (vb:447) Setting stream to dead state, last_seqno is 76237, unAckedBytes is 0, status is The stream closed due to a close stream message
|
2019-10-01T13:21:30.481402-07:00 INFO 82: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.23->ns_1@172.23.104.17:other-1 - (vb:411) Setting stream to dead state, last_seqno is 76058, unAckedBytes is 0, status is The stream closed due to a close stream message
|
2019-10-01T13:21:30.481498-07:00 INFO 82: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.23->ns_1@172.23.104.17:other-1 - (vb:412) Setting stream to dead state, last_seqno is 75782, unAckedBytes is 0, status is The stream closed due to a close stream message
|
@
|
|
|
Attachments
Issue Links
- is duplicated by
-
MB-36255 [System Test]: Rebalance failed processing DCP_DELETION: PassiveDurabilityMonitor::completeSyncWrite No tracked, but received commit for key
- Closed