Uploaded image for project: 'Couchbase Monitoring and Observability Stack'
  1. Couchbase Monitoring and Observability Stack
  2. CMOS-295

Heartbeat performs redundant REST requests

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 0.3
    • None
    • cluster-monitor
    • None

    Description

      Here's the debug logs from a single heartbeat run for a single cluster:

      2022-02-02T09:52:44.679Z DEBUG (Single Cluster Manager) Heat beat for cluster {"cluster": "231b609b71c38e0819f6d51386fab218", "hosts": ["https://10.112.208.101:18091"]}
      2022-02-02T09:52:44.683Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/default/nodeServices'
      2022-02-02T09:52:44.690Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/default/nodeServices'
      2022-02-02T09:52:44.690Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools'
      2022-02-02T09:52:44.691Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools'
      2022-02-02T09:52:44.691Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/default'
      2022-02-02T09:52:44.694Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/default'
      2022-02-02T09:52:44.694Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/default/buckets'
      2022-02-02T09:52:44.698Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/default/buckets'
      2022-02-02T09:52:44.699Z INFO (REST) Successfully connected to cluster | {"enterprise":true,"uuid":"231b609b71c38e0819f6d51386fab218","developer_preview":false,"version":{"min_version":"6.6.3","is_mixed_cluster":false},"max_vbuckets":1024,"uniform_vbuckets":true}
      2022-02-02T09:52:44.719Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/default'
      2022-02-02T09:52:44.721Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/default'
      2022-02-02T09:52:44.721Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/nodes'
      2022-02-02T09:52:44.722Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/nodes'
      2022-02-02T09:52:44.722Z DEBUG (REST) (Attempt 1) (GET) Dispatching request to 'https://10.112.208.101:18091/pools/default/buckets'
      2022-02-02T09:52:44.726Z DEBUG (REST) (Attempt 1) (GET) (200) Received response from 'https://10.112.208.101:18091/pools/default/buckets'
      2022-02-02T09:52:44.728Z DEBUG (Single Cluster Manager) Heart beat complete {"cluster": "231b609b71c38e0819f6d51386fab218", "elapsed": 0.049267494}
      

      (this refers to the "Single Cluster Manager", which is a WIP patch, but it uses the exact same logic as the existing Heart Monitor.)

      It looks like, after cbrest has bootstrapped, we perform requests for /pools/default, /pools/nodes, and /pools/default/buckets. /pools/nodes we do need to perform, but it looks like cbrest already requests the other two, meaning that our requests are potentially redundant.

      We should investigate if we can reuse the data that cbrest already gets us, potentially filing a patch against cbrest if it doesn't expose the information we need.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Unassigned Unassigned
            marks.polakovs Marks Polakovs (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty