Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62575

cbas process cluster monitors timing out / restarting every 60s

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown
    • Analytics Sprint 45

    Description

      As observed in https://issues.couchbase.com/browse/MB-62557, the following messages seems to be on-going for a long time:

      2024-06-30T09:51:51.528+00:00 ERRO CBAS.cbas error from clusterCompatibility monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...
       
      2024-06-30T09:51:51.528+00:00 ERRO CBAS.cbas error from serverGroups monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...
       
      2024-06-30T09:51:51.528+00:00 ERRO CBAS.cbas error from developerPreview monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...
       
      2024-06-30T09:51:56.529+00:00 INFO CBAS.cbas Stopped clusterCompatibility monitor
      2024-06-30T09:51:56.529+00:00 INFO CBAS.cbas Starting clusterCompatibility monitor

      observed timeframe (happens once every 1 minute + 5 seconds):

      2024-06-30T09:23:41.493+00:00 ERRO CBAS.cbas error from developerPreview monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...
       
      2024-06-30T09:24:46.495+00:00 ERRO CBAS.cbas error from developerPreview monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s... 
      ...
      2024-06-30T13:11:11.820+00:00 ERRO CBAS.cbas error from developerPreview monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...
       
      2024-06-30T13:12:16.820+00:00 ERRO CBAS.cbas error from developerPreview monitor endpoint: context deadline exceeded (Client.Timeout or context cancellation while reading body), restarting in 5s...

      Logs:

      s3://cb-customers-secure/my-organization/2024-06-30/collectinfo-2024-06-30t131052-ns_1@svc-da-node-004.hqhgqppn5-7blfco.sandbox.nonprod-project-avengers.com-redacted-7ead76ba848c0f6d.zip

       

      Attachments

        Activity

          People

            umang.agrawal Umang
            Hussain.Towaileb Hussain Towaileb
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty