Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-19806

[windows] online upgrade from 3.1.3 to watson 2594 rebalance failed with error "error,{badrpc,nodedown}},\n {gen_server,call,\n [{'janitor_agent-default'..."

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • bug-backlog
    • 4.5.0
    • view-engine
    • Windows 2012 R2 64-bit
    • Untriaged
    • Windows 64-bit
    • Yes

    Description

      Run test
      newupgradetests.MultiNodesUpgradeTests.online_upgrade_rebalance_in_with_ops,initial_version=3.1.3-1823,sasl_buckets=1,standard_buckets=1,items=10000,nodes_init=2,nodes_in=1,nodes_out=1,ddocs-num=1,upgrade_version=4.5.0-2594,get-cbcollect-info=True,skip_init_check_cbserver=true

      {u'node': u'ns_1@172.23.107.119', u'code': 2, u'text': u"Rebalance exited with reason {unexpected_exit,\n                              {'EXIT',<0.89.4>,\n                               {bulk_set_vbucket_state_failed,\n                                [{'ns_1@172.23.107.119',\n                                  {'EXIT',\n                                   {{error,{badrpc,nodedown}},\n                                    {gen_server,call,\n                                     [{'janitor_agent-default',\n                                       'ns_1@172.23.107.119'},\n                                      {if_rebalance,<0.9533.3>,\n                                       {update_vbucket_state,172,replica,\n                                        undefined,'ns_1@172.23.105.91'}},\n                                      infinity]}}}}]}}}\n", u'shortText': u'message', u'serverTime': u'2016-05-27T17:41:57.483Z', u'module': u'ns_orchestrator', u'tstamp': 1464396117483, u'type': u'info'}
      [2016-05-27 17:42:01,528] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.119', u'code': 0, u'text': u"<0.82.4> exited with {unexpected_exit,\n                      {'EXIT',<0.89.4>,\n                       {bulk_set_vbucket_state_failed,\n                        [{'ns_1@172.23.107.119',\n                          {'EXIT',\n                           {{error,{badrpc,nodedown}},\n                            {gen_server,call,\n                             [{'janitor_agent-default','ns_1@172.23.107.119'},\n                              {if_rebalance,<0.9533.3>,\n                               {update_vbucket_state,172,replica,undefined,\n                                'ns_1@172.23.105.91'}},\n                              infinity]}}}}]}}}", u'shortText': u'message', u'serverTime': u'2016-05-27T17:41:57.317Z', u'module': u'ns_vbucket_mover', u'tstamp': 1464396117317, u'type': u'critical'}
      [2016-05-27 17:42:01,529] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.119', u'code': 0, u'text': u'Bucket "default" rebalance appears to be swap rebalance', u'shortText': u'message', u'serverTime': u'2016-05-27T17:37:18.406Z', u'module': u'ns_vbucket_mover', u'tstamp': 1464395838406, u'type': u'info'}
      [2016-05-27 17:42:01,529] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.119', u'code': 0, u'text': u'Bucket "default" loaded on node \'ns_1@172.23.107.119\' in 0 seconds.', u'shortText': u'message', u'serverTime': u'2016-05-27T17:37:17.066Z', u'module': u'ns_memcached', u'tstamp': 1464395837066, u'type': u'info'}
      [2016-05-27 17:42:01,531] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.142', u'code': 0, u'text': u'Shutting down bucket "bucket0" on \'ns_1@172.23.107.142\' for deletion', u'shortText': u'message', u'serverTime': u'2016-05-27T17:37:16.816Z', u'module': u'ns_memcached', u'tstamp': 1464395836816, u'type': u'info'}
      [2016-05-27 17:42:01,532] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.119', u'code': 0, u'text': u'Started rebalancing bucket default', u'shortText': u'message', u'serverTime': u'2016-05-27T17:37:16.168Z', u'module': u'ns_rebalancer', u'tstamp': 1464395836168, u'type': u'info'}
      [2016-05-27 17:42:01,533] - [rest_client:2530] ERROR - {u'node': u'ns_1@172.23.107.119', u'code': 0, u'text': u'Bucket "bucket0" rebalance appears to be swap rebalance', u'shortText': u'message', u'serverTime': u'2016-05-27T17:28:50.896Z', u'module': u'ns_vbucket_mover', u'tstamp': 1464395330896, u'type': u'info'}
      

      This test passed in build 4.5.0-2587
      Rerun the test again with build 4.5.0-2594, the test passed

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            asingh Abhishek Singh (Inactive)
            thuan Thuan Nguyen
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty