Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-29029

Rebalance failure in windows sanity

    XMLWordPrintable

Details

    • Untriaged
    • Windows 64-bit
    • Yes

    Description

      Script to Repro

      ./testrunner -i /tmp/4_nodes_windows_16.ini -p get-logs=true,get-cbcollect-info=true -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=1000,doc_ops=create;update;delete
      

      Logs

      [2018-03-31 12:02:09,778] - [rest_client:1448] INFO - rebalance params : {'password': 'password', 'ejectedNodes': '', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.109.185,ns_1@172.23.109.186,ns_1@172.23.109.187,ns_1@172.23.104.142'}
      [2018-03-31 12:02:10,090] - [rest_client:1453] INFO - rebalance operation started
      [2018-03-31 12:02:10,370] - [rest_client:1584] ERROR - {u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.'} - rebalance failed
      [2018-03-31 12:02:10,561] - [rest_client:3117] INFO - Latest logs from UI on 172.23.109.185:
      [2018-03-31 12:02:10,562] - [rest_client:3118] ERROR - {u'node': u'ns_1@172.23.109.185', u'code': 0, u'text': u'Rebalance exited with reason {badmatch,\n                              {leader_activities_error,\n                               {default,rebalance},\n                               {domain_conflict,\n                                {activity_token,\n                                 {\'ns_1@172.23.109.185\',\n                                  <<"beb9cec29459ae122f15017fca8b151f">>},\n                                 <<"4cdffa82c809d69750ef34b2c179d5bf">>,\n                                 default,\n                                 [rebalance],\n                                 []},\n                                {activity,<0.22698.4>,#Ref<0.0.3.98913>,\n                                 default,\n                                 <<"e4f9a13d88e2b2a5cf412f177f53eff2">>,\n                                 [{service_janitor,index,\n                                   maybe_complete_pending_failover}],\n                                 majority,\n                                 [quiet]}}}}', u'shortText': u'message', u'serverTime': u'2018-03-31T12:02:09.974Z', u'module': u'ns_orchestrator', u'tstamp': 1522522929974, u'type': u'critical'}
      

      Logs attached.

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-29029
          # Subject Branch Project Status CR V

          Activity

            People

              Balakumaran.Gopal Balakumaran Gopal
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty