Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55832

[Magma-CDC] Magma fragmentation exceeds the configured value(for few shards and remains in the same state)

    XMLWordPrintable

Details

    Description

      1. Create a 4 node cluster
      2. Create a magma buckets with (bucket_history_retention_seconds=0,bucket_history_retention_bytes=200000000000,)
        just default collection, vbuckets=64
      3. Create 10 million docs(doc_size = 2KB)
      4. Start deleting all the documents
      5. While deletes are going on start creating new 10 million docs as well
      6. At the end of above steps observed Magma fragmentation for few shards is more than 50%(test keeps checking for 300 seconds before asserting for fragmentation, manually checked after 20 mins it was still close to 60 percent)

      Cbstats for 172.23.107.126(shard 8, magma.7)

       rw_7:magma:                   {"ActiveBloomFilterSize":594654,"ActiveDataSize":501879104,"ActiveDiskUsage":959299584,"ActiveIndexBlocksSize":6554801,"BlockCacheHitRatio":96.63487243652344,"BlockCacheHits":1183897,"BlockCacheHitsPerSec":0.0,"BlockCacheMemUsed":14995408,"BlockCacheMisses":41227,"BlockCacheMissesPerSec":0.0,"BlockCacheQuota":26526679,"BloomFilterFPR":0.021259525790810585,"BloomFilterMemUsedRatio":0.0006566665833815932,"BloomFilterMemoryQuota":998034633,"BufferMemUsed":19712,"BytesIncoming":1436407827,"BytesIncomingPerSec":0.0,"BytesOutgoing":0,"BytesOutgoingPerSec":0.0,"BytesPerRead":53.40143966674805,"CheckpointOverhead":0,"CheckpointOverheadPeriod":600,"CheckpointOverheadRatio":0.0,"CompactQueueSize":0,"DataBlocksCompressSize":923505431,"DataBlocksCompressionRatio":1.552644356890631,"DataBlocksSize":1433875496,"DataBlocksSpaceReductionEstimate":35.59375039351394,"FlushQueueSize":8,"Fragmentation":0.5952277779579163,"FragmentationWithHistory":0.4768275320529938,

      Data
      https://cb-engineering.s3.amazonaws.com/data/172_23_107_221.tar.gz
      https://cb-engineering.s3.amazonaws.com/data/172_23_107_76.tar.gz
      https://cb-engineering.s3.amazonaws.com/data/172_23_107_126.tar.gz
      https://cb-engineering.s3.amazonaws.com/data/172_23_107_237.tar.gz

      QE-TEST:

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/temp_vol_3.ini bucket_storage=magma,bucket_eviction_policy=fullEviction,randomize_value=True,rerun=false,replicas=0,test_itr=10,enable_dp=false,get-cbcollect-info=True,autoCompactionDefined=true,bucket_history_retention_bytes=200000000000,upgrade_version=7.2.0-5225 -t storage.magma.magma_deletes.BasicDeleteTests.test_parallel_creates_deletes,num_items=10000000,mix_key_size=True,nodes_init=4,sdk_timeout=60,vbuckets=64,count_ts=False,process_concurrency=4,test_itr=1,GROUP=vb64;P0,skip_cleanup=True'

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ankush.sharma Ankush Sharma
            ankush.sharma Ankush Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty