Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42782

[S3] cbbackupmgr should retry "connection reset by peer" errors during a restore

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • No

    Description

      What's the issue?
      During a restore, 'cbbackupmgr' may encounter "connection reset by peer" errors when reading from the data store. At the moment these errors are causing the restore to fail because they are not actively retried by the AWS SDK.

      What's the fix?
      We should add some sort of retry reader functionality into restore which will keep track of the state of the download and retry the API request in the event of a failure due to the connection being reset by S3.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Ascending order - Click to sort in descending order
          build-team Couchbase Build Team added a comment -

          Build couchbase-server-6.6.2-9429 contains backup commit 10ab1c1 with commit message:
          MB-42782 Retry failed reads due to 'connection reset by peer' errors

          build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9429 contains backup commit 10ab1c1 with commit message: MB-42782 Retry failed reads due to 'connection reset by peer' errors
          build-team Couchbase Build Team added a comment -

          Build couchbase-server-7.0.0-4215 contains backup commit 10ab1c1 with commit message:
          MB-42782 Retry failed reads due to 'connection reset by peer' errors

          build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4215 contains backup commit 10ab1c1 with commit message: MB-42782 Retry failed reads due to 'connection reset by peer' errors
          joe.mitchelljones Joe Mitchell Jones added a comment -

          Valid unit testing is in place here, closing this.

          joe.mitchelljones Joe Mitchell Jones added a comment - Valid unit testing is in place here, closing this.
          james.lee James Lee added a comment -

          Release note:
          cbbackupmgr will now retry 'connection reset by peer' errors whilst streaming vBucket data files allowing large restores to complete as expected

          james.lee James Lee added a comment - Release note: cbbackupmgr will now retry 'connection reset by peer' errors whilst streaming vBucket data files allowing large restores to complete as expected

          People

            james.lee James Lee
            james.lee James Lee
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty