Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-14822

Rebalance failure during swap rebalance

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 4.0.0
    • 4.0.0
    • ns_server
    • Security Level: Public
    • None
    • 4.0.0-2043 Enterprise Edition (build-2043)

    Description

      1. Install CB Server on 6 nodes
      2. Create 8 buckets
      3. Add 2 nodes to the cluster
      4. Create data to the cluster
      5. Remove 2 nodes but do not rebalance
      6. Add 3 nodes to the cluster
      7. Start rebalance
      Rebalance fails with error.
      [2015-05-05 03:18:55,846] - [rest_client:1270] ERROR -

      {u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try rebalance again.'}

      - rebalance failed
      [2015-05-05 03:18:55,940] - [rest_client:2184] INFO - Latest logs from UI on 10.3.5.115:
      [2015-05-05 03:18:55,940] - [rest_client:2185] ERROR - {u'node': u'ns_1@10.3.5.115', u'code': 2, u'text': u"Rebalance exited with reason {unexpected_exit,\n {'EXIT',<0.31518.14>,\n shutdown,\n {gen_server,call,\n ['dcp_consumer_conn-bucket-6-ns_1@10.3.5.117',\n get_partitions,infinity],\n {gen_server,call,\n [

      {'janitor_agent-bucket-6','ns_1@10.3.5.115'},\n {if_rebalance,<0.26040.14>,\n {update_vbucket_state,86,active,undefined,\n undefined}},\n infinity]}}}}\n", u'shortText': u'message', u'serverTime': u'2015-05-05T03:18:51.151Z', u'module': u'ns_orchestrator', u'tstamp': 1430821131151, u'type': u'info'}
      [2015-05-05 03:18:55,941] - [rest_client:2185] ERROR - {u'node': u'ns_1@10.3.5.115', u'code': 0, u'text': u"<0.31415.14> exited with {unexpected_exit,\n {'EXIT',<0.31518.14>,\n shutdown,\n {gen_server,call,\n ['dcp_consumer_conn-bucket-6-ns_1@10.3.5.117',\n get_partitions,infinity],\n {gen_server,call,\n [{'janitor_agent-bucket-6','ns_1@10.3.5.115'}

      ,\n {if_rebalance,<0.26040.14>,\n {update_vbucket_state,86,active,undefined,\n undefined}},\n infinity]}}}}", u'shortText': u'message', u'serverTime': u'2015-05-05T03:18:51.149Z', u'module': u'ns_vbucket_mover', u'tstamp': 1430821131149, u'type': u'critical'}

      Logs at - https://s3.amazonaws.com/bugdb/jira/MB-14822/logs.tar

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            artem Artem Stemkovski
            ritam.sharma Ritam Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty