Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-27813

KV rebalance hangs with ongoing mutations

    XMLWordPrintable

Details

    • Untriaged
    • No

    Description

      Build- 5.5.0-1632
      Observed KV rebalance stuck around 95% when eventing application processing mutations in performance test.
      Job- http://perf.jenkins.couchbase.com/job/themis-dev/97/
      Logs- eventing-2.log.zip

      Also reported here

      Observed on 5.5.0-1785

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          wayne Wayne Siu added a comment -

          What's the current status of this ticket?  Thanks.

          wayne Wayne Siu added a comment - What's the current status of this ticket?  Thanks.

          I haven't got chance to look into yet because of other priority functional/sys test bugs that I had to address. I understand this is a bad bug and needs to be fixed in vulcan, but want to sort out long running blocker bug MB-27452 before I get on with this bug atm.

          asingh Abhishek Singh (Inactive) added a comment - I haven't got chance to look into yet because of other priority functional/sys test bugs that I had to address. I understand this is a bad bug and needs to be fixed in vulcan, but want to sort out long running blocker bug MB-27452 before I get on with this bug atm.

          Addressed via http://review.couchbase.org/91239 . Gave 3 runs on themis-dev with toy build, 3 runs went through.

          Sample successful jekins job - http://perf.jenkins.couchbase.com/job/themis-dev/335/console

          asingh Abhishek Singh (Inactive) added a comment - - edited Addressed via http://review.couchbase.org/91239 . Gave 3 runs on themis-dev with toy build, 3 runs went through. Sample successful jekins job - http://perf.jenkins.couchbase.com/job/themis-dev/335/console

          Build couchbase-server-5.5.0-2268 contains eventing commit 05b655da6ab5772654ce98328d8cae14522c6559 with commit message:
          MB-27813 Restream vbuckets even if Eventing rebalance is yet to be triggered
          https://github.com/couchbase/eventing/commit/05b655da6ab5772654ce98328d8cae14522c6559

          build-team Couchbase Build Team added a comment - Build couchbase-server-5.5.0-2268 contains eventing commit 05b655da6ab5772654ce98328d8cae14522c6559 with commit message: MB-27813 Restream vbuckets even if Eventing rebalance is yet to be triggered https://github.com/couchbase/eventing/commit/05b655da6ab5772654ce98328d8cae14522c6559

          Build couchbase-server-5.5.0-2268 contains eventing commit 069a52ed07a8b85180c30f3f9bb80671ce68465c with commit message:
          MB-27813 Request failover logs for ALL vbukets instead of ones...
          https://github.com/couchbase/eventing/commit/069a52ed07a8b85180c30f3f9bb80671ce68465c

          build-team Couchbase Build Team added a comment - Build couchbase-server-5.5.0-2268 contains eventing commit 069a52ed07a8b85180c30f3f9bb80671ce68465c with commit message: MB-27813 Request failover logs for ALL vbukets instead of ones... https://github.com/couchbase/eventing/commit/069a52ed07a8b85180c30f3f9bb80671ce68465c

          Build couchbase-server-5.5.0-2268 contains eventing commit 32170f2dd755feb138e317daf870d1f8ae0125b7 with commit message:
          MB-27813 Coordinate STREAMREQ calls between routine handling...
          https://github.com/couchbase/eventing/commit/32170f2dd755feb138e317daf870d1f8ae0125b7

          build-team Couchbase Build Team added a comment - Build couchbase-server-5.5.0-2268 contains eventing commit 32170f2dd755feb138e317daf870d1f8ae0125b7 with commit message: MB-27813 Coordinate STREAMREQ calls between routine handling... https://github.com/couchbase/eventing/commit/32170f2dd755feb138e317daf870d1f8ae0125b7

          Verified that KV rebalance is completed with ongoing mutations.
          Job- http://perf.jenkins.couchbase.com/job/themis/481/

          mahesh.mandhare Mahesh Mandhare (Inactive) added a comment - Verified that KV rebalance is completed with ongoing mutations. Job- http://perf.jenkins.couchbase.com/job/themis/481/

          People

            asingh Abhishek Singh (Inactive)
            mahesh.mandhare Mahesh Mandhare (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty