Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-35990

Rebalance In 2 nodes failed for ephemeral bucket

    XMLWordPrintable

Details

    • Bug
    • Resolution: Not a Bug
    • Critical
    • 6.5.0
    • 6.5.0
    • test-execution
    • 6.5.0-4282

    Description

      Steps to reproduce:
      1. Initialize a 3 node cluster

      +----------------+----------+--------------+
      | Nodes          | Services | Status       |
      +----------------+----------+--------------+
      | 172.23.105.220 | [u'kv']  | Cluster node |
      | 172.23.105.221 | None     | <--- IN ---  |
      | 172.23.105.223 | None     | <--- IN ---  |
      +----------------+----------+--------------+
      

      2. Create 1 bucket with bucket type ephemeral and eviction policy as noEviction and replicas = 2.

      http://172.23.105.220:8091/pools/default/buckets with param: maxTTL=0&flushEnabled=1&compressionMode=off&bucketType=ephemeral&name=default&replicaNumber=2&ramQuotaMB=1424&threadsNumber=3&evictionPolicy=noEviction
      

      Load 100k docs with durability=MAJORITY

      +---------+-----------+----------+-----+--------+------------+-----------+-----------+
      | Bucket  | Type      | Replicas | TTL | Items  | RAM Quota  | RAM Used  | Disk Used |
      +---------+-----------+----------+-----+--------+------------+-----------+-----------+
      | default | ephemeral | 1        | 0   | 250000 | 5997854720 | 195164064 | 136       |
      +---------+-----------+----------+-----+--------+------------+-----------+-----------+
      

      3. Load another 100k docs with durability=MAJORITY and do a rebalance IN of 2 nodes

      +----------------+----------+--------------+
      | Nodes          | Services | Status       |
      +----------------+----------+--------------+
      | 172.23.105.220 | [u'kv']  | Cluster node |
      | 172.23.105.223 | [u'kv']  | Cluster node |
      | 172.23.105.221 | [u'kv']  | Cluster node |
      | 172.23.105.225 | None     | <--- IN ---  |
      | 172.23.105.226 | None     | <--- IN ---  |
      +----------------+----------+--------------+
      

      4. Rebalance Failed:

      {pre_rebalance_janitor_run_failed,"default",
      {error,unsafe_nodes,['ns_1@172.23.105.223']}}.
      Rebalance Operation Id = c69663e53c2dfb3d6429ba5a9113da77
      

      Test to validate:

      gradle-site-plugin/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P args="-i /tmp/ritesh.ini -t rebalance_new.rebalance_in.RebalanceInTests.rebalance_in_with_warming_up,nodes_init=3,nodes_in=2,num_items=100000,replicas=2,GROUP=P1;durability -p num_items=100000,durability=MAJORITY,bucket_type=ephemeral,get-cbcollect-info=True,skip_cleanup=True -p infra_log_level=debug,log_level=debug -m rest"
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty