Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11624

Missing curr_items(1K) after rebalance out on cluster

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 3.0
    • 3.0
    • couchbase-bucket
    • Security Level: Public
    • None
    • Build : 3.0.0-918-rel
    • Untriaged
    • Unknown
    • June 30 - July 18

    Description

      Test to repro:
      ./testrunner -i b/resources/your.ini -t rebalance.rebalanceout.RebalanceOutTests.rebalance_out_with_ops,nodes_out=3,replicas=3,items=100000,doc_ops=create:update:delete,max_verify=100000,value_size=1024,dgm_run=true,eviction_policy=fullEviction,active_resident_threshold=90

      Test fails on verification of curr_items.

      ======================================================================
      ERROR: rebalance_out_with_ops (rebalance.rebalanceout.RebalanceOutTests)
      ----------------------------------------------------------------------
      Traceback (most recent call last):
      File "pytests/rebalance/rebalanceout.py", line 87, in rebalance_out_with_ops
      self.verify_cluster_stats(self.servers[:self.num_servers - self.nodes_out])
      File "pytests/basetestcase.py", line 629, in verify_cluster_stats
      self._verify_stats_all_buckets(servers, timeout=(timeout or 120))
      File "pytests/basetestcase.py", line 411, in _verify_stats_all_buckets
      raise Exception("unable to get expected stats during

      {0}

      sec".format(timeout))
      Exception: unable to get expected stats during 120 sec

      ----------------------------------------------------------------------

      The cbstats displays likewise information

      vb_replica_curr_items > curr_items.

      root@ubu-12301:/opt/couchbase/bin# ./cbstats localhost:11211 all | grep curr_
      curr_connections: 28
      curr_conns_on_port_11207: 4
      curr_conns_on_port_11209: 51
      curr_conns_on_port_11210: 6
      curr_items: 249999
      curr_items_tot: 500033
      curr_temp_items: 0
      vb_active_curr_items: 249999
      vb_pending_curr_items: 0
      vb_replica_curr_items: 250034

      There are no pending items on any intra replication queues.

      Attaching logs from the cluster

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ketaki Ketaki Gangal (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty