Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47576

[System test upgrade] - Negative values returned for page_bytes, page_itemcnt and avg_page_size post upgrade

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • No

    Description

      Steps to Repro
      1. Run the following 6.6.2 longevity test for 4 days.

      ./sequoia -client 172.23.96.162:2375 -provider file:centos_third_cluster.yml -test tests/integration/test_allFeatures_madhatter_durability.yml -scope tests/integration/scope_Xattrs_Madhatter.yml -scale 3 -repeat 0 -log_level 0 -version 6.6.2-9588 -skip_setup=true -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
      

      2. At this point we would have 27 node cluster(3 analytics, 3 index, 3 fts, 3 query, 6 index, 9 data).
      3. Failover(graceful for kv) 6 nodes (one of each service type), upgrade and do a recovery(delta for kv) and rebalance.
      4. Repeat the above step until all the nodes in the cluster are upgraded.

      Noticed a few -ve values post upgrade in stats.

      172.23.106.117 : index

      stats/storage : [(u'page_bytes', -29822), (u'page_itemcnt', -507), (u'avg_page_size', -1863)]
      stats : None
      

      from cbcollect of 172.23.106.117

      Balakumarans-MacBook-Pro-2:cbcollect_info_ns_1@172.23.106.117_20210726-100002 balakumaran.g$ grep page_bytes ns_server.indexer.log | grep '        -' | wc -l
           273
      Balakumarans-MacBook-Pro-2:cbcollect_info_ns_1@172.23.106.117_20210726-100002 balakumaran.g$ grep page_itemcnt ns_server.indexer.log | grep '        -' | wc -l
           273
      Balakumarans-MacBook-Pro-2:cbcollect_info_ns_1@172.23.106.117_20210726-100002 balakumaran.g$ grep avg_page_size ns_server.indexer.log | grep '        -' | wc -l
           273
      

      Balakumarans-MacBook-Pro-2:cbcollect_info_ns_1@172.23.106.117_20210726-100002 balakumaran.g$ curl -u Administrator:password 172.23.106.117:9102/stats/storage |  grep '        -'
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                       Dload  Upload   Total   Spent    Left  Speed
      100 33875    0 33875    0     0  44397      0 --:--:-- --:--:-- --:--:-- 44339
      "page_bytes":           -81254,
      "page_itemcnt":         -1420,
      "avg_page_size":        -5803,
      Balakumarans-MacBook-Pro-2:cbcollect_info_ns_1@172.23.106.117_20210726-100002 balakumaran.g$ 
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            akhil.mundroy Akhil Mundroy
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty