Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46451

[BP MB-45743 to 6.6.4] [System Test] [MOI] seeing negative values for avg_item_size, raw_data_size, key_size_distribution & backstore_raw_data_size stats

    XMLWordPrintable

Details

    Description

      Build : 7.0.0-4951
      Test : -test tests/2i/cheshirecat/test_idx_clusterops_cheshire_cat_moi.yml -scope tests/2i/cheshirecat/scope_idx_cheshire_cat_moi.yml (MOI)
      Scale : 2
      Iteration : 1st (6-7 hrs of test run)

      On 172.23.107.3, the following stats have negative values :
      stats : [(u'bucket3:scope_0:coll_3:idx1_wNvBW:avg_item_size', -98), (u'bucket3:scope_0:coll_3:idx1_wNvBW:raw_data_size', -5826156), (u'bucket3:scope_0:coll_3:idx1_wNvBW:backstore_raw_data_size', -125796), (u'(65-256)', -33194)]

      Upon checking the indexer_stats.log, the first occurrence of the negative stats was recorded at 2021-04-15T21:32:23

      2021-04-15T21:32:23.789-07:00 index_bucket3:scope_0:coll_3:idx1_wNvBW:6159441098657129496 {"avg_mutation_rate":40,"avg_scan_latency":78391628,"avg_scan_rate":1063,"avg_scan_request_init_latency":738961,"avg_scan_request_latency":25367778,"avg_scan_wait_latency":368209,"avg_ts_interval":9958746,"backstore_raw_data_size":-230,"client_cancel_errcount":54,"key_size_distribution":{"(65-256)":-68},"last_known_scan_time":1618547501382999215,"num_completed_requests":76,"num_docs_indexed":84016,"num_docs_pending":2,"num_docs_processed":60329638,"num_docs_queued":4,"num_flush_queued":84016,"num_items_flushed":68,"num_requests":76,"num_rows_returned":1137356,"num_rows_scanned":3884052,"num_snapshots":15212,"progress_stat_time":"1618547540123044877","raw_data_size":-12007,"scan_bytes_read":28568523,"scan_req_init_latency_dist":{"(0ms-2ms)":72},"scan_req_latency_dist":{"(100ms-1000ms)":3},"scan_req_wait_latency_dist":{"(0ms-2ms)":74},"scan_wait_duration":27983893,"since_last_snapshot":10116122,"snapshot_gen_latency_dist":{"(0ms-2ms)":243609,"(2ms-5ms)":258},"timings/dcp_getseqs":"37 50926205 78335799271535","total_scan_duration":1870707498,"total_scan_request_duration":1927951160}
      

      Similar issues were seen earlier and fixed : MB-41788, MB-36982.

      This hasn't been seen in the recent runs of the same test. The last run was on 7.0.0-4854

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              jeelan.poola Jeelan Poola
              kevin.cherkauer Kevin Cherkauer (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty