Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46377

[System Test] Seeing negative value for est_disk_size storage stat

    XMLWordPrintable

Details

    Description

      Build : 7.0.0-5177 (RC1)
      Test : -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale : 3
      Iteration : 1st

      Seeing negative value for est_disk_size storage stat on 172.23.121.117. The first occurence can be seen in the logs for the Storage Stats dump at 2021-05-18T18:12:16.426. At this time, the system was rebalancing in the failed over and recovered node 172.23.121.117.

      [2021-05-18T16:13:55-07:00, sequoiatools/couchbase-cli:7.0:3d21b6] failover -c 172.23.108.103:8091 --server-failover 172.23.121.117:8091 -u Administrator -p password --hard
      [2021-05-18T16:14:02-07:00, sequoiatools/couchbase-cli:7.0:361ef8] recovery -c 172.23.108.103:8091 --server-recovery 172.23.121.117:8091 --recovery-type full -u Administrator -p password
      [2021-05-18T16:14:09-07:00, sequoiatools/couchbase-cli:7.0:6a8169] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      [2021-05-18T19:49:13-07:00, sequoiatools/cmd:b6349f] 60
      

      HQ-Computer:cbcollect_info_ns_1@172.23.121.117_20210519-025355 mihirkamdar$ cat ns_server.indexer.log | grep "\"est_disk_size\"\:        -"
      "est_disk_size":        -101751,
      "est_disk_size":        -120081,
      "est_disk_size":        -109771,
      "est_disk_size":        -109805,
      "est_disk_size":        -101803,
      "est_disk_size":        -120116,
      "est_disk_size":        -120119,
      "est_disk_size":        -109953,
      "est_disk_size":        -101982,
      "est_disk_size":        -102047,
      "est_disk_size":        -120174,
      "est_disk_size":        -109991,
      "est_disk_size":        -102046,
      "est_disk_size":        -120174,
      "est_disk_size":        -109991,
      

      Indexer nodes : 172.23.104.67, 172.23.104.70, 172.23.105.107, 172.23.121.117, 172.23.96.252, 172.23.96.253

      This seems to be a regression since this issue was fixed in MB-44316.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            mihir.kamdar Mihir Kamdar (Inactive)
            mihir.kamdar Mihir Kamdar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty