Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-35203

Rebalance in failed with "Some apps are being paused"

    XMLWordPrintable

    Details

    • Triage:
      Untriaged
    • Is this a Regression?:
      Unknown

      Description

      Build: 6.5.0-3821

      Test: test_1 (3).zip

      /testrunner -i /tmp/testexec.27136.ini -p get-cbcollect-info=True,GROUP=bucket_op_curl -t eventing.eventing_rebalance.EventingRebalance.test_eventing_rebalance_in_when_existing_eventing_node_is_processing_mutations,nodes_init=4,services_init=kv-eventing-index-n1ql,dataset=default,groups=simple,reset_services=True,doc-per-day=20,handler_code=bucket_op_curl_jenkins,curl=True,GROUP=bucket_op_curl,pause_resume=True,host=http://qa.sc.couchbase.com/ 

       {u'node': u'ns_1@172.23.98.165', u'code': 0, u'text': u'Rebalance exited with reason {service_rebalance_failed,eventing,\n                              {{badmatch,\n                                {error,\n                                 {unknown_error,\n                                  <<"Some apps are being paused, node: 172.23.98.168:8096">>}}},\n                               [{service_rebalancer,rebalance,8,\n                                 [{file,"src/service_rebalancer.erl"},\n                                  {line,126}]},\n                                {proc_lib,init_p,3,\n                                 [{file,"proc_lib.erl"},{line,232}]}]}}.\nRebalance Operation Id = 23f143d8a73de6b981983f80dcb941b0', u'shortText': u'message', u'serverTime': u'2019-07-19T16:01:47.283Z', u'module': u'ns_orchestrator', u'tstamp': 1563577307283, u'type': u'critical'} 

      Test: test_4.zip

      ./testrunner -i /tmp/testexec.27136.ini -p get-cbcollect-info=True,GROUP=bucket_op_curl -t eventing.eventing_rebalance.EventingRebalance.test_kv_rebalance_out_when_existing_eventing_node_is_processing_mutations,nodes_init=7,services_init=kv-kv-kv-eventing-eventing-eventing-index:n1ql,dataset=default,groups=simple,reset_services=True,doc-per-day=20,handler_code=bucket_op_curl_jenkins,curl=True,GROUP=bucket_op_curl,host=http://qa.sc.couchbase.com/ 

      [2019-07-20 09:51:00,172] - [rest_client:3250] ERROR - {u'node': u'ns_1@172.23.98.165', u'code': 0, u'text': u'Rebalance exited with reason {service_rebalance_failed,eventing,\n                              {{badmatch,\n                                {error,\n                                 {unknown_error,\n                                  <<"Some apps are being paused, node: 172.23.98.18:8096">>}}},\n                               [{service_rebalancer,rebalance,8,\n                                 [{file,"src/service_rebalancer.erl"},\n                                  {line,126}]},\n                                {proc_lib,init_p,3,\n                                 [{file,"proc_lib.erl"},{line,232}]}]}}.\nRebalance Operation Id = 418843b40276f2e276e7f4f5c93717d6', u'shortText': u'message', u'serverTime': u'2019-07-20T09:50:55.399Z', u'module': u'ns_orchestrator', u'tstamp': 1563641455399, u'type': u'critical'} 

        Attachments

        1. test_1 (3).zip
          16.72 MB
        2. test_4.zip
          71.12 MB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          jeelan.poola Jeelan Poola added a comment -

          Hi Vikas Chaudhary, this is change in behaviour we discussed last week. Has the test already changed to accommodate waiting got pause to complete?

          Show
          jeelan.poola Jeelan Poola added a comment - Hi Vikas Chaudhary , this is change in behaviour we discussed last week. Has the test already changed to accommodate waiting got pause to complete?
          Hide
          vikas.chaudhary Vikas Chaudhary added a comment -
          Show
          vikas.chaudhary Vikas Chaudhary added a comment - Fixed  http://review.couchbase.org/#/c/112266/

            People

            Assignee:
            vikas.chaudhary Vikas Chaudhary
            Reporter:
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Gerrit Reviews

                There are no open Gerrit changes

                  PagerDuty