Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10730

Rebalance exited with reason "bulk_set_vbucket_state_failed" during rebalance+views test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 3.0
    • 3.0
    • ns_server, view-engine
    • Security Level: Public
    • None
    • Triaged
    • Ubuntu 64-bit
    • Yes

    Description

      Build Tested : 3.0.0-535-rel

      Test Failed:
      ./testrunner -i -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_out,num_nodes_to_add=1,limit=1

      Jenkins Job:
      http://qa.sc.couchbase.com/view/3.0.0/job/ubuntu_x64--65_02--view_query_extended-P1/57/consoleFull

      Test Logs:
      [rebalance:debug,2014-04-02T4:36:44.849,ns_1@172.23.106.196:<0.26055.6>:janitor_agent:bulk_set_vbucket_state:382]bulk vbucket state change failed for:
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,wrong_rebalancer_pid},
      [

      {janitor_agent,set_vbucket_state,7},
      {janitor_agent,'-bulk_set_vbucket_state/4-fun-0-',4},
      {misc,'-parallel_map/3-fun-0-',4}]}}}]
      [ns_server:info,2014-04-02T4:36:44.851,ns_1@172.23.106.196:janitor_agent-default<0.24771.5>:janitor_agent:handle_info:817]Undoing temporary vbucket states caused by rebalance
      [ns_server:debug,2014-04-02T4:36:44.851,ns_1@172.23.106.196:<0.26070.6>:ns_pubsub:do_subscribe_link:136]Parent process of subscription {ns_node_disco_events,<0.26055.6>} exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,
      wrong_rebalancer_pid},
      [{janitor_agent, set_vbucket_state, 7},
      {janitor_agent, '-bulk_set_vbucket_state/4-fun-0-', 4},
      {misc, '-parallel_map/3-fun-0-', 4}]}}}]},
      [{janitor_agent, bulk_set_vbucket_state, 4},
      {ns_vbucket_mover, update_replication_post_move, 3},
      {ns_vbucket_mover, on_move_done, 2},
      {gen_server, handle_msg, 5},
      {proc_lib, init_p_do_apply, 3}]}
      [user:info,2014-04-02T4:36:44.852,ns_1@172.23.106.196:<0.21035.1>:ns_orchestrator:handle_info:480]Rebalance exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,wrong_rebalancer_pid},
      [{janitor_agent,set_vbucket_state,7}

      ,

      {janitor_agent, '-bulk_set_vbucket_state/4-fun-0-',4}

      ,

      {misc,'-parallel_map/3-fun-0-',4}

      ]}}}]},
      [

      {janitor_agent,bulk_set_vbucket_state,4}

      ,

      {ns_vbucket_mover, update_replication_post_move,3}

      ,

      {ns_vbucket_mover,on_move_done,2}

      ,

      {gen_server,handle_msg,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}

      [ns_server:debug,2014-04-02T4:36:44.852,ns_1@172.23.106.196:compaction_daemon<0.483.0>:compaction_daemon:handle_info:456]Looks like vbucket mover inhibiting view compaction for for bucket "default" is dead. Canceling inhibition

      Uploading Logs

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              Meenakshi Meenakshi Goel
              Meenakshi Meenakshi Goel
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty