Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10980

unable to stop rebalance when it stuck

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 3.0
    • 3.0
    • ns_server
    • Security Level: Public
    • None
    • 3.0.0-614-rel
    • Untriaged
    • Unknown

    Description

      http://qa.hq.northscale.net/view/All/job/ubuntu_x64--38_01--cbrecovery-P1/35/consoleFull

      after cbrecovery we call rebalance and it stuck

      [2014-04-27 06:15:46,784] - [task:2881] INFO - cbrecovery completed succesfully
      [2014-04-27 06:15:49,392] - [cbRecoverytests:68] INFO - Cbrecovery caught up bucket default... 50000 == 50000
      [2014-04-27 06:15:50,033] - [rest_client:1052] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%40172.23.106.106%2Cns_1%4010.3.3.233%2Cns_1%4010.3.5.46%2Cns_1%4010.1.3.72%2Cns_1%40172.23.106.105
      [2014-04-27 06:15:50,558] - [rest_client:1056] INFO - rebalance operation started
      [2014-04-27 06:15:50,608] - [rest_client:1157] INFO - rebalance percentage : 0 %
      [2014-04-27 06:15:52,618] - [rest_client:1157] INFO - rebalance percentage : 0.0651041666667 %
      [2014-04-27 06:15:54,702] - [rest_client:1157] INFO - rebalance percentage : 0.0651041666667 %
      [2014-04-27 06:15:57,573] - [rest_client:1157] INFO - rebalance percentage : 0.0651041666667 %
      [2014-04-27 06:15:59,605] - [rest_client:1157] INFO - rebalance percentage : 0.0651041666667 %

      then in all the tests we try to stop it, but all in vain. I can not do it through the UI or through Rest API request

      curl -X POST -i --user Administrator:password http://10.3.3.233:8091/controller/stopRebalance
      HTTP/1.1 200 OK
      Server: MochiWeb/1.0 (Any of you quaids got a smint?)
      Date: Mon, 28 Apr 2014 14:07:13 GMT
      Content-Length: 0

      Andreis-MacBook-Pro:~ andrei$ curl http://10.3.3.233:8091/pools/default/rebalanceProgress
      Andreis-MacBook-Pro:~ andrei$ curl http://Administrator:password@10.3.3.233:8091/pools/default/rebalanceProgress
      {"status":"running","ns_1@10.3.3.233":

      {"progress":0.001953125}

      ,"ns_1@172.23.106.105":

      {"progress":0}

      ,"ns_1@172.23.106.106":{"progress":0}}

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            andreibaranouski Andrei Baranouski
            andreibaranouski Andrei Baranouski
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty