Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42829

[Collections] Flush::saveCollectionStats items:1 + -1, highSeq:1882, diskSize:91 + -92

    XMLWordPrintable

Details

    Description

      Script to Repo

      ./testrunner -i /tmp/durability_volume.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_hard_failover_recovery,nodes_init=5,nodes_failover=1,recovery_type=full,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,GROUP=failover_with_collection_crud_durability_MAJORITY

      Steps to Repro
      1.  Create a 5 node cluster
      2020-11-18 16:04:50,523 | test | INFO | pool-18-thread-7 | [table_view:display:72] Rebalance Overview
      -----------------------++-------------

      Nodes Services Status

      -----------------------++-------------

      172.23.120.137 kv Cluster node
      172.23.120.138 None <--- IN —
      172.23.120.139 None <--- IN —
      172.23.120.140 None <--- IN —
      172.23.120.142 None <--- IN —

      -----------------------++-------------

      2.  Create buckets, collections and load initial data

      --------------------------------------------------------------------------

      Bucket Type Replicas Durability TTL Items RAM Quota RAM Used Disk Used

      --------------------------------------------------------------------------

      bucket1 couchbase 2 none 0 3000 1048576000 188176944 186654739
      bucket2 ephemeral 2 none 0 3000 1048576000 274420304 170
      default couchbase 2 none 0 500000 10485760000 646611664 646833677

      --------------------------------------------------------------------------

      3.  Hard Failover a node and full recover the node with collection CRUD in parallel, and rebalance
      Rebalance fails

      2020-11-18 16:21:20,881 | test | ERROR | MainThread | [basetestcase:check_coredump_exist:683] Node 172.23.120.139 - Core dump seen: 1

      Observations

      172.23.120.139 : Found message in /opt/couchbase/var/lib/couchbase/logs/memcached.log.000277.txt
      CRITICAL.txt

      Attachments

        1. bt_full.txt
          41 kB
        2. CRITICAL.txt
          31 kB

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-39946 [Collections] Underflow of diskSize - total size (bytes) of items in this collection on disk

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sumedh.basarkod Sumedh Basarkod (Inactive)
              sumedh.basarkod Sumedh Basarkod (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty