Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Allow getting per-partition stats for index replicas

Description

Reported in the forum post.

https://forums.couchbase.com/t/index-statistics-api-and-replicas/28944

Possible problem 1:
Some of the partitions are missing in the output.

Steps to reproduce:

1. Setup a cluster with 2 indexer nodes

2. Create a partitioned index with replica.

3. Call /api/v1/stats/bucket-name/index-name on each of the indexer nodes. This does not return stats for all partitions.

Possible problem 2:
As reported in the forum post, the stats returned are can belong to different replica ids when called at different times. Needs further analysis.

Components

Affects versions

Fix versions

Labels

Environment

None

Link to Log File, atop/blg, CBCollectInfo, Core dump

None

Release Notes Description

None

Activity

Show:

Hemant Rajput March 5, 2021 at 9:30 AM

lfc@Hemants-MacBook-Pro testrunner % curl -u Administrator:password http://10.112.190.102:9102/api/v1/stats/default/new

{"default:new":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":0,"disk_size":0,"frag_percent":0,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":0,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"default:new (replica 1)":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":0,"disk_size":0,"frag_percent":0,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":0,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0}}%                           lfc@Hemants-MacBook-Pro testrunner % curl -u Administrator:password http://10.112.190.101:9102/api/v1/stats/default/new

{"default:new":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":0,"disk_size":0,"frag_percent":0,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":0,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"default:new (replica 1)":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":0,"disk_size":0,"frag_percent":0,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":0,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0}}%                           lfc@Hemants-MacBook-Pro testrunner % curl -u Administrator:password http://10.112.190.101:9102/api/v1/stats/default/new?partition=true

{"Partition-1":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-2":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-3":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-4":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-5":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-6":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-7":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"Partition-8":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":32784,"disk_size":98304,"frag_percent":16,"initial_build_progress":0,"items_count":0,"last_known_scan_time":0,"memory_used":64,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"default:new":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":163920,"disk_size":491520,"frag_percent":16,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":320,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0},"default:new (replica 1)":{"avg_drain_rate":0,"avg_item_size":0,"avg_scan_latency":0,"cache_hit_percent":0,"cache_hits":0,"cache_misses":0,"data_size":98352,"disk_size":294912,"frag_percent":16,"initial_build_progress":100,"items_count":0,"last_known_scan_time":0,"memory_used":192,"num_docs_indexed":0,"num_docs_pending":0,"num_docs_queued":0,"num_items_flushed":0,"num_pending_requests":0,"num_requests":0,"num_rows_returned":0,"num_scan_errors":0,"num_scan_timeouts":0,"recs_in_mem":0,"recs_on_disk":0,"resident_percent":0,"scan_bytes_read":0,"total_scan_duration":0}}%                                                                                                      lfc@Hemants-MacBook-Pro testrunner % 

CB robot March 4, 2021 at 8:35 AM

Build couchbase-server-7.0.0-4606 contains indexing commit d99536b with commit message:
: Allow getting per-partition stats for all index replicas

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Is this a Regression?

Unknown

Triage

Untriaged

Story Points

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created January 3, 2021 at 7:49 PM
Updated July 9, 2021 at 5:21 AM
Resolved March 4, 2021 at 7:29 AM
Instabug