Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10730

Rebalance exited with reason "bulk_set_vbucket_state_failed" during rebalance+views test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 3.0
    • 3.0
    • ns_server, view-engine
    • Security Level: Public
    • None
    • Triaged
    • Ubuntu 64-bit
    • Yes

    Description

      Build Tested : 3.0.0-535-rel

      Test Failed:
      ./testrunner -i -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_out,num_nodes_to_add=1,limit=1

      Jenkins Job:
      http://qa.sc.couchbase.com/view/3.0.0/job/ubuntu_x64--65_02--view_query_extended-P1/57/consoleFull

      Test Logs:
      [rebalance:debug,2014-04-02T4:36:44.849,ns_1@172.23.106.196:<0.26055.6>:janitor_agent:bulk_set_vbucket_state:382]bulk vbucket state change failed for:
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,wrong_rebalancer_pid},
      [

      {janitor_agent,set_vbucket_state,7},
      {janitor_agent,'-bulk_set_vbucket_state/4-fun-0-',4},
      {misc,'-parallel_map/3-fun-0-',4}]}}}]
      [ns_server:info,2014-04-02T4:36:44.851,ns_1@172.23.106.196:janitor_agent-default<0.24771.5>:janitor_agent:handle_info:817]Undoing temporary vbucket states caused by rebalance
      [ns_server:debug,2014-04-02T4:36:44.851,ns_1@172.23.106.196:<0.26070.6>:ns_pubsub:do_subscribe_link:136]Parent process of subscription {ns_node_disco_events,<0.26055.6>} exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,
      wrong_rebalancer_pid},
      [{janitor_agent, set_vbucket_state, 7},
      {janitor_agent, '-bulk_set_vbucket_state/4-fun-0-', 4},
      {misc, '-parallel_map/3-fun-0-', 4}]}}}]},
      [{janitor_agent, bulk_set_vbucket_state, 4},
      {ns_vbucket_mover, update_replication_post_move, 3},
      {ns_vbucket_mover, on_move_done, 2},
      {gen_server, handle_msg, 5},
      {proc_lib, init_p_do_apply, 3}]}
      [user:info,2014-04-02T4:36:44.852,ns_1@172.23.106.196:<0.21035.1>:ns_orchestrator:handle_info:480]Rebalance exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@172.23.106.199',
      {'EXIT',
      {{badmatch,wrong_rebalancer_pid},
      [{janitor_agent,set_vbucket_state,7}

      ,

      {janitor_agent, '-bulk_set_vbucket_state/4-fun-0-',4}

      ,

      {misc,'-parallel_map/3-fun-0-',4}

      ]}}}]},
      [

      {janitor_agent,bulk_set_vbucket_state,4}

      ,

      {ns_vbucket_mover, update_replication_post_move,3}

      ,

      {ns_vbucket_mover,on_move_done,2}

      ,

      {gen_server,handle_msg,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}

      [ns_server:debug,2014-04-02T4:36:44.852,ns_1@172.23.106.196:compaction_daemon<0.483.0>:compaction_daemon:handle_info:456]Looks like vbucket mover inhibiting view compaction for for bucket "default" is dead. Canceling inhibition

      Uploading Logs

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-10730
          # Subject Branch Project Status CR V

          Activity

            People

              Meenakshi Meenakshi Goel
              Meenakshi Meenakshi Goel
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty