Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60089

[Rebalance] : Rebalance exited with reason {{badmatch,{error,{{badmatch,{errors,[{'ns_1@172.23.107.50',bad_node}]}},[{ns_vbucket_mover,init,1,[{file,"src/ns_vbucket_mover.erl"},{line,138}]},{gen_server,init_it

    XMLWordPrintable

Details

    Description

      Steps to repro

      1. Created 2 couchstore buckets named 'bucket1' and 'bucket0'
      2. Added 5 nodes to the cluster and rebalanced
      3. Failed over node 172.23.107.49, 172.23.107.53, 172.23.109.4
      4. Started a rebalance to remove the nodes

      Rebalance failed 

      2023-12-11T05:29:32.781-08:00, ns_orchestrator:0:critical:message(ns_1@172.23.107.49) - Rebalance exited with reason {{badmatch,                               {error,                                {{badmatch,                                  {errors,[{'ns_1@172.23.107.50',bad_node}]}},                                 [{ns_vbucket_mover,init,1,                                   [{file,"src/ns_vbucket_mover.erl"},                                    {line,138}]},                                  {gen_server,init_it,2,                                   [{file,"gen_server.erl"},{line,851}]},                                  {gen_server,init_it,6,                                   [{file,"gen_server.erl"},{line,814}]},                                  {proc_lib,init_p_do_apply,3,                                   [{file,"proc_lib.erl"},{line,240}]}]}}},                              [{ns_rebalancer,'-run_mover/6-fun-0-',5,                                [{file,"src/ns_rebalancer.erl"},{line,693}]},                               {misc,with_trap_exit,1,                                [{file,"src/misc.erl"},{line,2728}]},                               {ns_rebalancer,run_mover,6,                                [{file,"src/ns_rebalancer.erl"},{line,691}]},                               {ns_rebalancer,do_rebalance_membase_bucket,5,                                [{file,"src/ns_rebalancer.erl"},{line,670}]},                               {ns_rebalancer,rebalance_membase_bucket,6,                                [{file,"src/ns_rebalancer.erl"},{line,633}]},                               {lists,foreach_1,2,                                [{file,"lists.erl"},{line,1442}]},                               {ns_rebalancer,rebalance_kv,4,                                [{file,"src/ns_rebalancer.erl"},{line,573}]},                               {ns_rebalancer,rebalance_body,5,                                [{file,"src/ns_rebalancer.erl"},{line,524}]}]}.Rebalance Operation Id = 1745cbd793bb0b5fb3db314d34eaaf83

      Testrunner script to reproduce

      ./testrunner -i /data/workspace/debian-p0-tunable-vset00-00-swaprebalance/testexec.23164.ini -p max-dupe-result-count=10,,num-tries=60,attempt-num=60,dgm_run=true,eviction_policy=fullEviction,GROUP=P0,get-cbcollect-info=True,sirius_url=http://172.23.120.103:4000 -t swaprebalance.SwapRebalanceFailedTests.test_add_back_failed_node,replica=2,num-buckets=2,num-swap=3,swap-orchestrator=True,GROUP=P0

       Job name : debian-tunable-swaprebalance

      Job ref : http://cb-logs-qe.s3-website-us-west-2.amazonaws.com/7.2.4-7059/jenkins_logs/test_suite_executor/652622/

      Attachments

        Activity

          People

            raghav.sk Raghav S K
            raghav.sk Raghav S K
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty