Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-31340

[Upgrade] After upgrade 3 nodes cluster from 5.0.1 to Alice (1643), rebalance failed when add additional Alice node to cluster

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 6.0.0
    • 6.0.0
    • fts
    • Centos 7
    • Untriaged
    • Centos 64-bit
    • Yes

    Description

      Create a cluster of 3 nodes 5.0.1 version (224, 225 and 226)

      Online upgrade cluster (swap rebalance) to Alice 6.0.0-1643 (224, 226 and 227).

      Add an additional Alice node (225) to cluster, rebalance failed with error:

      u'Rebalance exited with reason {service_rebalance_failed,fts,\n                              {rebalance_failed,\n                               {service_error,\n                                <<"planner: planPIndexesPrev.ImplVersion: 5.5.0 > version: 5.0.0">>}}}', u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:48.664Z', u'module': u'ns_orchestrator', u'tstamp': 1537289568664, u'type': u'critical'}
      2018-09-18 09:52:48,922 - root - ERROR - {u'node': u'ns_1@172.23.121.227', u'code': 0, u'text': u'Bucket "default" rebalance does not seem to be swap rebalance', u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:20.770Z', u'module': u'ns_vbucket_mover', u'tstamp': 1537289540770, u'type': u'info'}
      2018-09-18 09:52:48,922 - root - ERROR - {u'node': u'ns_1@172.23.121.225', u'code': 0, u'text': u'Bucket "default" loaded on node \'ns_1@172.23.121.225\' in 0 seconds.', u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:18.639Z', u'module': u'ns_memcached', u'tstamp': 1537289538639, u'type': u'info'}
      2018-09-18 09:52:48,923 - root - ERROR - {u'node': u'ns_1@172.23.121.227', u'code': 0, u'text': u'Started rebalancing bucket default', u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:18.361Z', u'module': u'ns_rebalancer', u'tstamp': 1537289538361, u'type': u'info'}
      2018-09-18 09:52:48,923 - root - ERROR - {u'node': u'ns_1@172.23.121.227', u'code': 4, u'text': u"Starting rebalance, KeepNodes = ['ns_1@172.23.121.224','ns_1@172.23.121.226',\n                                 'ns_1@172.23.121.225','ns_1@172.23.121.227'], EjectNodes = [], Failed over and being ejected nodes = []; no delta recovery nodes\n", u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:18.158Z', u'module': u'ns_orchestrator', u'tstamp': 1537289538158, u'type': u'info'}
      2018-09-18 09:52:48,923 - root - ERROR - {u'node': u'ns_1@172.23.121.225', u'code': 0, u'text': u'Hot-reloaded memcached.json for config change of the following keys: [<<"scramsha_fallback_salt">>]', u'shortText': u'message', u'serverTime': u'2018-09-18T09:52:18.043Z', u'module': u'memcached_config_mgr', u'tstamp': 1537289538043, u'type': u'info'}
       

      I will find the last build passed this test.

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            thuan Thuan Nguyen
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty