Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-19846

[system tests windows] Rebalance exited with reason bad_replicas

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • None
    • 4.5.0
    • couchbase-bucket
    • 4.5.0-2600
    • Untriaged
    • Windows 64-bit
    • Unknown

    Description

      seems like it's the same problem as MB-19255

      steps:
      Install CB server 4.5.0-2600

      Setup 3 nodes cluster as SRC cluster.(172.23.105.87, 172.23.105.94, 172.23.107.85)
      Setup 3 nodes cluster as DEST cluster.(172.23.107.11, 172.23.106.191, 172.23.106.83)
      At each cluster, create 4 buckets
      AbRegNums (0.7GB), MsgsCalls (0.7GB), RevAB (5GB) and UserInfo (0.6GB)
      1) load data on SRC in 24 hours.
      2) After running load in more than 1 day, started replication from cluster SRC to cluster DEST.
      3) rebalance in 172.23.108.44 at cluster SRC (MB-19708)
      rebalance in 172.23.107.227 at cluster DEST
      result: Rebalance exited with reason bad_replicas

       
      Rebalance exited with reason bad_replicas
      ns_orchestrator 002	ns_1@172.23.107.11	1:46:57 PM Sun Jun 5, 2016
      Bad replicators after rebalance:
      Missing = [{'ns_1@172.23.106.83','ns_1@172.23.107.11',513},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',514},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',515},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',516},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',517},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',518},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',519},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',520},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',521},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',522},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',523},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',524},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',525},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',526},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',527},
                 {'ns_1@172.23.106.83','ns_1@172.23.107.11',528},
              ... show	ns_rebalancer 002	ns_1@172.23.107.11	1:46:57 PM Sun Jun 5, 2016
      Bucket "RevAB" rebalance does not seem to be swap rebalance	ns_vbucket_mover 000	ns_1@172.23.107.11	1:30:48 PM Sun Jun 5, 2016
      Bucket "RevAB" loaded on node 'ns_1@172.23.107.227' in 0 seconds.	ns_memcached 000	ns_1@172.23.107.227	1:30:45 PM Sun Jun 5, 2016
      Started rebalancing bucket RevAB	ns_rebalancer 000	ns_1@172.23.107.11	1:30:43 PM Sun Jun 5, 2016
      Bucket "UserInfo" rebalance does not seem to be swap rebalance	ns_vbucket_mover 000	ns_1@172.23.107.11	1:24:45 PM Sun Jun 5, 2016
      Bucket "UserInfo" loaded on node 'ns_1@172.23.107.227' in 0 seconds.	ns_memcached 000	ns_1@172.23.107.227	1:24:43 PM Sun Jun 5, 2016
      Started rebalancing bucket UserInfo	ns_rebalancer 000	ns_1@172.23.107.11	1:24:39 PM Sun Jun 5, 2016
      Starting rebalance, KeepNodes = ['ns_1@172.23.106.191','ns_1@172.23.106.83',
                                       'ns_1@172.23.107.11','ns_1@172.23.107.227'], EjectNodes = [], Failed over and being ejected nodes = []; no delta recovery nodes
      ns_orchestrator 004	ns_1@172.23.107.11	1:24:38 PM Sun Jun 5, 2016
      
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            dhaikney David Haikney (Inactive)
            andreibaranouski Andrei Baranouski
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty