Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-36798

Ephemeral: Rebalance failed on removing other nodes after 1 node is restarted and auto-reprovisioning is triggered.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Critical
    • backlog
    • 6.5.0
    • ns_server
    • 6.5.0-4744

    Description

      1. Create a 7 node cluster and ephemeral bucket(replicaNumber=2) and load 250k items in the bucket
      2. Restart server on one of the node(172.23.105.221). Auto-Reprovisioning kicks in.
      3. Do not rebalance the cluster at this point
      4. Remove 5 nodes which doesn't include the node in step 2

      Starting rebalance, KeepNodes = ['ns_1@172.23.105.220','ns_1@172.23.105.221'], EjectNodes = ['ns_1@172.23.105.223',
      		 
      'ns_1@172.23.105.225',
      		 
      'ns_1@172.23.105.226',
      		 
      'ns_1@172.23.105.227',
      		 
      'ns_1@172.23.105.208'], Failed over and being ejected nodes = []; no delta recovery nodes; Operation Id = ccc0b99e13cffe3a87f89c533e3c5bbe

      5. Hit rebalance. Rebalance failed

      Rebalance exited with reason {pre_rebalance_janitor_run_failed,"default",
      		 
      {error,unsafe_nodes,['ns_1@172.23.105.221']}}.
      		 
      Rebalance Operation Id = ccc0b99e13cffe3a87f89c533e3c5bbe

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            artem Artem Stemkovski
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty