Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-36262

[System Test] DCP_DELETION: No Prepare waiting for completion, but received commit for key

    XMLWordPrintable

Details

    Description

      Build : 6.5.0-4380
      Test : -test tests/rebalance/test_allRebalance_durability.yml -scope tests/rebalance/scope_rebalanceBase_durability.yml
      Scale : 2

      On nodes 172.23.104.17, the following type of errors are seen in the memcached logs.

      2019-10-01T13:21:30.180391-07:00 INFO 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:789) Attempting to add takeover stream: opaque_:47, start_seqno_:75780, end_seqno_:18446744073709551615, vb_uuid:266534241399010, snap_start_seqno_:75780, snap_end_seqno_:75780, last_seqno:75780, stream_req_value:{"uid":"0"}
      2019-10-01T13:21:30.189889-07:00 ERROR 108: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f91fd868e10","ewouldblock":false,"packet":{"bodylen":40,"cas":1569961289254109184,"datatype":"raw","extlen":21,"key":"<ud>.BEBD9644-40_111979</ud>","keylen":19,"magic":"ClientRequest","opaque":47,"opcode":"DCP_DELETION","vbucket":789},"refcount":1}] - closing connection ([ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): PassiveDurabilityMonitor::completeSyncWrite vb:789 No Prepare waiting for completion, but received commit for key <ud>cid:0x0:BEBD9644-40_111979</ud>
      2019-10-01T13:21:30.190005-07:00 INFO 108: (No Engine) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - Removing connection [ 127.0.0.1:49718 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]
      2019-10-01T13:21:30.190041-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:789) Setting stream to dead state, last_seqno is 75786, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
      2019-10-01T13:21:30.190079-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:779) Setting stream to dead state, last_seqno is 76067, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
      2019-10-01T13:21:30.190096-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:780) Setting stream to dead state, last_seqno is 76081, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
      2019-10-01T13:21:30.190109-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:787) Setting stream to dead state, last_seqno is 75932, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
      2019-10-01T13:21:30.190124-07:00 WARNING 108: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.18->ns_1@172.23.104.17:other-1 - (vb:781) Setting stream to dead state, last_seqno is 75950, unAckedBytes is 0, status is The stream closed early because the conn was disconnected
      2019-10-01T13:21:30.480689-07:00 INFO 102: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.19->ns_1@172.23.104.17:other-1 - (vb:446) Setting stream to dead state, last_seqno is 76047, unAckedBytes is 0, status is The stream closed due to a close stream message
      2019-10-01T13:21:30.480831-07:00 INFO 102: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.19->ns_1@172.23.104.17:other-1 - (vb:447) Setting stream to dead state, last_seqno is 76237, unAckedBytes is 0, status is The stream closed due to a close stream message
      2019-10-01T13:21:30.481402-07:00 INFO 82: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.23->ns_1@172.23.104.17:other-1 - (vb:411) Setting stream to dead state, last_seqno is 76058, unAckedBytes is 0, status is The stream closed due to a close stream message
      2019-10-01T13:21:30.481498-07:00 INFO 82: (other-1) DCP (Consumer) eq_dcpq:replication:ns_1@172.23.104.23->ns_1@172.23.104.17:other-1 - (vb:412) Setting stream to dead state, last_seqno is 75782, unAckedBytes is 0, status is The stream closed due to a close stream message
      @                                                                                                                                                                     
       
      
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              girish.benakappa Girish Benakappa
              girish.benakappa Girish Benakappa
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty