Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46888

[S3] cbbackupmgr should not use a 'bufio.Reader' for the upload pool

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 6.6.3
    • 6.6.0, 6.6.1, 6.6.2
    • tools
    • Untriaged
    • 1
    • No

    Description

      What's the issue?
      We currently wrap the reader we pass to the 's3manager.Upload' function with a 'bufio.Reader', this is fine, however, it's not seekable; this leads to excessive memory usage since instead of using 'io.SectionReader's it read the data into memory.

      What's the fix?
      We don't wrap the file reader with a 'bufio.Reader'.

      Attachments

        Issue Links

          Activity

            People

              james.lee James Lee
              james.lee James Lee
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty