Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44794

[Magma] Disk usage after deleting all the documents exceeds expected size (for small data sizes (<25 GB), checkpoints==0)

    XMLWordPrintable

Details

    Description

      Description:
      For small data sizes (less than 25/30 GB), Disk usage exceeds the expected value , Below were the numbers observed in test (also the test steps)

      1. Created 25 million items (doc size 1024), Disk size == 16GB
      2. Deleted all the documents
      3. Trigger full compaction(Tombstone size = 2GB)
      4. Recreated all 25 million documents
      5. Delete all documents
      6. Disk size is 22.5 GB, Expected (16GB+ 2GB )

      Note : In above test default commit point were zeo

      QE TEST:

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/ankush.ini bucket_storage=magma,GROUP=vb1024;P0,bucket_eviction_policy=fullEviction,randomize_value=True,rerun=false,replicas=0,disable_magma_commit_points=True,test_itr=2,get-cbcollect-info=True,infra_log_level=critical,log_level=debug,upgrade_version=7.0.0-4617 -t magma.magma_deletes.BasicDeleteTests.test_create_delete_n_times,upgrade_version=7.0.0-4617,rerun=false,test_itr=2,GROUP=vb1024;P0,disable_magma_commit_points=True,sdk_timeout=60,get-cbcollect-info=True,replicas=0,bucket_storage=magma,log_level=debug,bucket_eviction_policy=fullEviction,nodes_init=4,num_items=25000000,randomize_doc_size=True,randomize_value=True,key_size=22,infra_log_level=debug,skip_cleanup=True -m rest'
      

      DATA:
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/small_data/default_125.tar.gz
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/small_data/default_122.tar.gz
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/small_data/default_155.tar.gz
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/small_data/default_159.tar.gz

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ankush.sharma Ankush Sharma
            ankush.sharma Ankush Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty