Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47868

[Magma] CRITICAL (default) MagmaKVStore::saveDocs vb:296 WriteDocs failed. Status:Invalid: kvstore-296/rev-000000001: seqno (9800) should always increase monotonically between write batches (10786) numCommits:12(DISK FULL TESTS)

    XMLWordPrintable

Details

    Description

      STEPS TO RECREATE:

      1. Create a 4 node cluster
      2. Create 5 million items (doc size = 2048) and replicas =1
      3. Fill entire disk , ( "fallocate -l <space left on disk> <file_name>")
      4. After Disk is full, Start doc ops create:upsert docs until RAM is full (Enusred using cbstats, when ep_data_write_failed > 0)
      5. Increase the replica, rebalance

      Memcached Logs:
      Error found on Node 172.23.107.16

      CRITICAL (default) MagmaKVStore::saveDocs vb:296 WriteDocs failed. Status:Invalid: kvstore-296/rev-000000001: seqno (9800) should always increase monotonically between write batches (10786) numCommits:12

      QE-TEST:

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.127316.ini bucket_storage=magma,rerun=false,bucket_eviction_policy=fullEviction,randomize_value=True,enable_dp=false,GROUP=P0,get-cbcollect-info=True,infra_log_level=info,log_level=info,bucket_storage=magma,upgrade_version=7.1.0-1120 -t storage.magma.magma_disk_full.MagmaDiskFull.test_disk_full_on_increasing_replica,nodes_init=4,num_items=5000000,doc_size=2048,sdk_timeout=60,replicas=0,GROUP=P0'

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sarath Sarath Lakshman
            ankush.sharma Ankush Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty