Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60712

[TC] [REST] Investigate retries for Client.Timeout errors

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • Major
    • master
    • master
    • tools-common
    • None
    • 0

    Description

      What's the issue?

      2024-02-06T10:23:23.264+00:00 ERRO: (REST) (Attempt 1) (GET) Failed to perform request to 'https://svc-dqisea-node-001.kdcqnxvjgk0x83a.sandbox.nonprod-project-avengers.com:18093/api/v1/bucket/default1/backup': Get "https://svc-dqisea-node-001.kdcqnxvjgk0x83a.sandbox.nonprod-project-avengers.com:18093/api/v1/bucket/default1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers) -- logging.ToolsCommonLogger.Log() at tools_common.go:30
      2024-02-06T10:23:23.264+00:00 WARN: (REST) (Attempt 1) (GET) Request to endpoint '/api/v1/bucket/default1/backup' failed due to error: failed to perform request: Get "https://svc-dqisea-node-001.kdcqnxvjgk0x83a.sandbox.nonprod-project-avengers.com:18093/api/v1/bucket/default1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers) -- logging.ToolsCommonLogger.Log() at tools_common.go:28
      2024-02-06T10:23:23.264+00:00 (Cmd) Error backing up cluster: failed to execute cluster operations: failed to execute bucket operation for bucket 'default1': failed to transfer Query metadata for bucket 'default1': failed to get Query metadata: failed to get Query metadata: failed to execute request: failed to execute request: failed to perform request: Get "https://svc-dqisea-node-001.kdcqnxvjgk0x83a.sandbox.nonprod-project-avengers.com:18093/api/v1/bucket/default1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
      

      Looking at these logs, we see only one attempt of a Client.Timeout error prior to exiting with an error.

      What's the fix?
      We should:

      1. Investigate whether Client.Timeout errors are retried
      2. Think about adding them if they're not

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              james.lee James Lee
              james.lee James Lee
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty