Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46099

130 node testing: Rebalance in 1 node in a 85 node cluster failed due to buckets_cleanup_failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.0.2
    • Cheshire-Cat
    • ns_server
    • 7.0.0-5085

    Description

      Steps:
      1. Create a 85 node cluster
      2. Create a bucket and 20 collections
      3. Start load: maxttl=60, durability=Majority
      4. Rebalance in 172.23.96.89. Rebalance failed due to bas replicas. buckets_cleanup_failed

      QE test

      		 
      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job4.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction,rerun=False -t volumetests.Magma.volume.SystemTestMagma,nodes_init=85,replicas=1,skip_cleanup=True,num_items=1000000000,num_buckets=1,bucket_names=GleamBook,doc_size=256,bucket_type=membase,compression_mode=off,iterations=100,batch_size=1000,sdk_timeout=60,log_level=debug,infra_log_level=info,skip_cleanup=True,key_size=18,randomize_doc_size=True,randomize_value=True,assert_crashes_on_load=True,doc_ops=update,maxttl=60,num_collections=20,durability=Majority,fragmentation=20,pc=2,crashes=10,sdk_client_pool=True -m rest'

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-45594 [System Test][couchbase-bucket] Rebalance failures with error buckets_cleanup_failed

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-45594 [System Test][couchbase-bucket] Rebalance failures with error buckets_cleanup_failed

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-46067 [Collections] - Rebalance in fails with Rebalance exited with reason {buckets_cleanup_failed,

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-47169 [high-bucket] - 30 multi bucket test rebalance failed with buckets_cleanup_failed error

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          For Gerrit Dashboard: MB-46099
          # Subject Branch Project Status CR V
          157903,4 MB-46099 [cbcollect_info] Control the amount of outstanding IO. cheshire-cat ns_server Status: MERGED +2 +1
          158187,1 Merge remote-tracking branch 'couchbase/cheshire-cat' master ns_server Status: MERGED +2 +1

          Activity

            People

              ritesh.agarwal Ritesh Agarwal
              ritesh.agarwal Ritesh Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty