Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-36584

[System test]: received unexpected commit for key

    XMLWordPrintable

Details

    Description

      Build: 6.5.0-4621

      Test: MH longevity

      Cycle: 1st

      Day : 1

      Seeing following error on .100 ERROR 469

      memcached<0.576.0>: 2019-10-21T19:59:31.229761-07:00 ERROR 469: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:58811 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f25f0579510","ewouldblock":false,"packet":{"bodylen":193,"cas":1571713171223281664,"datatype":"raw","extlen":31,"key":"<ud>00000000000000000013</ud>","keylen":20,"magic":"ClientRequest","opaque":28,"opcode":"DCP_PREPARE","vbucket":151},"refcount":1}] - closing connection ([ 127.0.0.1:58811 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): CheckpointManager::queueDirty(vb:151) - got Ckpt::queueDirty() status:failure:duplicate item when vbstate is non-active:2

      2019-10-21 20:49:50,020 - systestmon - DEBUG - memcached<0.576.0>: 2019-10-21T19:59:43.516953-07:00 ERROR 408: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:40528 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f264f42bd10","ewouldblock":false,"packet":{"bodylen":36,"cas":0,"datatype":"raw","extlen":16,"key":"<ud>00000000000000000013</ud>","keylen":20,"magic":"ClientRequest","opaque":2,"opcode":"DCP_COMMIT","vbucket":151},"refcount":1}] - closing connection ([ 127.0.0.1:40528 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): PassiveDurabilityMonitor::completeSyncWrite vb:151 Pending resolution for 'SW @0x7f2604297290 qi:[key:'<ud>cid:0x0:5AF88F02-22_1532806</ud>' seqno:192360 reqs:{Majority, timeout=infinite}]  status:Pending', but received unexpected commit for key <ud>cid:0x0:00000000000000000013</ud>

      ERROR 109 on .121

      2019-10-21 20:49:55,600 - systestmon - WARNING - *** 2 occurences of exception occurred in runloop keyword found on 172.23.97.121 ***
      2019-10-21 20:49:55,601 - systestmon - DEBUG - [ns_server:info,2019-10-21T19:59:33.458-07:00,babysitter_of_ns_1@cb.local:<0.115.0>:ns_port_server:log:224]memcached<0.115.0>: 2019-10-21T19:59:33.258027-07:00 ERROR 109: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:58129 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f18ac866710","ewouldblock":false,"packet":{"bodylen":469,"cas":1571713173245067264,"datatype":"raw","extlen":31,"key":"<ud>00000000000000001130</ud>","keylen":20,"magic":"ClientRequest","opaque":22,"opcode":"DCP_PREPARE","vbucket":726},"refcount":1}] - closing connection ([ 127.0.0.1:58129 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): CheckpointManager::queueDirty(vb:726) - got Ckpt::queueDirty() status:failure:duplicate item when vbstate is non-active:2

      [ns_server:info,2019-10-21T19:59:39.402-07:00,babysitter_of_ns_1@cb.local:<0.115.0>:ns_port_server:log:224]memcached<0.115.0>: 2019-10-21T19:59:39.202034-07:00 ERROR 110: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:45297 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007f18b97ec710","ewouldblock":false,"packet":{"bodylen":36,"cas":0,"datatype":"raw","extlen":16,"key":"<ud>00000000000000001130</ud>","keylen":20,"magic":"ClientRequest","opaque":3,"opcode":"DCP_COMMIT","vbucket":726},"refcount":1}] - closing connection ([ 127.0.0.1:45297 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): PassiveDurabilityMonitor::completeSyncWrite vb:726 Pending resolution for 'SW @0x7f18f441cf20 qi:[key:'<ud>cid:0x0:EDC9ABA3-73_1560649</ud>' seqno:158271 reqs:{Majority, timeout=infinite}]  status:Pending', but received unexpected commit for key <ud>cid:0x0:00000000000000001130</ud> 

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            ben.huddleston Ben Huddleston added a comment - - edited

            The "Ckpt::queueDirty() status:failure:duplicate item when vbstate is non-active:2" errors are due to MB-36338 which was resolved in build 6.5.0-4625. The following errors are fallout of the first.

            ben.huddleston Ben Huddleston added a comment - - edited The "Ckpt::queueDirty() status:failure:duplicate item when vbstate is non-active:2" errors are due to MB-36338 which was resolved in build 6.5.0-4625. The following errors are fallout of the first.

            People

              vikas.chaudhary Vikas Chaudhary
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty