Details
-
Bug
-
Resolution: Fixed
-
Major
-
6.6.0, 6.6.1, 6.6.2
-
Untriaged
-
1
-
No
Description
What's the issue?
We currently wrap the reader we pass to the 's3manager.Upload' function with a 'bufio.Reader', this is fine, however, it's not seekable; this leads to excessive memory usage since instead of using 'io.SectionReader's it read the data into memory.
What's the fix?
We don't wrap the file reader with a 'bufio.Reader'.
Attachments
Issue Links
- links to
For Gerrit Dashboard: MB-46888 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
155720,8 | MB-46888 Don't use a 'bufio.Reader' for the S3 upload pool | mad-hatter | backup | Status: MERGED | +2 | +1 |
156155,2 | Merge branch 'mad-hatter' into cheshire-cat | cheshire-cat | backup | Status: MERGED | +2 | +1 |
156187,1 | Merge branch 'cheshire-cat' into master | master | backup | Status: MERGED | +2 | +1 |