Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-40467

VBucket::handlePreExpiry may keep the body in the payload

    XMLWordPrintable

    Details

    • Triage:
      Triaged
    • Story Points:
      1
    • Is this a Regression?:
      No

      Description

      Using a 2 node cluster against 6.6.0 build 7873.

      When running the gocb test suite at some point during the TestQuery test the SDK connection is closed by the server and then all kv tests thereafter fail with temp fail. Looking in the server logs (attached) it looks like memcached crashes and doesn't recover. In the UI the bucket shows as "1 node pending".

      To repro create a 2 node cluster with kv,index,n1ql on one node and kv,index,n1ql,fts,cbas on the other. Create a default bucket. Clone https://github.com/couchbase/gocb and run tests with

      go test -race -v ./ --server <address> --user <user> --pass <password> --bucket default --version 6.5.0

      During the TestQuery test the logs will output an EOF and then the SDK will be unable to recover (and tests will take a long time to complete) due to memcached being down on one node. Unfortunately I've been unable to distill this down into a smaller repro case and I can't tell what is causing the crash. I can reliably reproduce this via our SDK jenkins and locally using our cbdyncluster infrastructure. This was not happening on build 7692 and does not happen against 6.5.1.

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            charles.dixon Charles Dixon created issue -
            raju Raju Suravarjjala made changes -
            Field Original Value New Value
            Priority Major [ 3 ] Critical [ 2 ]
            raju Raju Suravarjjala made changes -
            Component/s memcached [ 11621 ]
            raju Raju Suravarjjala made changes -
            Assignee Daniel Owen [ owend ]
            arunkumar Arunkumar Senthilnathan made changes -
            Labels combination_testing
            drigby Dave Rigby made changes -
            Assignee Daniel Owen [ owend ] Charles Dixon [ charles.dixon ]
            Resolution Duplicate [ 3 ]
            Status Open [ 1 ] Resolved [ 5 ]
            drigby Dave Rigby made changes -
            Link This issue duplicates MB-40370 [ MB-40370 ]
            owend Daniel Owen made changes -
            Environment 6.6.0-7873
            charles.dixon Charles Dixon made changes -
            Assignee Charles Dixon [ charles.dixon ] Daniel Owen [ owend ]
            Resolution Duplicate [ 3 ]
            Status Resolved [ 5 ] Reopened [ 4 ]
            charles.dixon Charles Dixon made changes -
            owend Daniel Owen made changes -
            Assignee Daniel Owen [ owend ] Paolo Cocchi [ paolo.cocchi ]
            owend Daniel Owen made changes -
            Fix Version/s 6.6.0 [ 16787 ]
            owend Daniel Owen made changes -
            Component/s memcached [ 11621 ]
            Component/s couchbase-bucket [ 10173 ]
            owend Daniel Owen made changes -
            Due Date 20/Jul/20
            paolo.cocchi Paolo Cocchi made changes -
            Triage Untriaged [ 10351 ] Triaged [ 10350 ]
            paolo.cocchi Paolo Cocchi made changes -
            Is this a Regression? Unknown [ 10452 ] No [ 10451 ]
            paolo.cocchi Paolo Cocchi made changes -
            Summary Go SDK tests can trigger memcached to crash VBucket::handlePreExpiry may leave the body in the payload
            paolo.cocchi Paolo Cocchi made changes -
            Summary VBucket::handlePreExpiry may leave the body in the payload VBucket::handlePreExpiry may keep the body in the payload
            drigby Dave Rigby made changes -
            Link This issue duplicates MB-40370 [ MB-40370 ]
            till Till Westmann made changes -
            Link This issue blocks MB-38724 [ MB-38724 ]
            till Till Westmann made changes -
            Labels combination_testing approved-for-6.6.0 combination_testing
            paolo.cocchi Paolo Cocchi made changes -
            Assignee Paolo Cocchi [ paolo.cocchi ] Charles Dixon [ charles.dixon ]
            Resolution Fixed [ 1 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            ritam.sharma Ritam Sharma made changes -
            VERIFICATION STEPS Closing as verification was done by Charles.
            Status Resolved [ 5 ] Closed [ 6 ]
            pvarley Patrick Varley made changes -
            Link This issue relates to MB-42352 [ MB-42352 ]

              People

              Assignee:
              charles.dixon Charles Dixon
              Reporter:
              charles.dixon Charles Dixon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Due:
                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes

                    PagerDuty