Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-54851

[CBM] Research how to stop GCP "multipart" uploads being orphaned

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • Morpheus
    • 7.0.0, 7.1.0
    • tools
    • None
    • Untriaged
    • 0
    • Unknown

    Description

      What is the problem?
      In AWS we use multipart uploads to upload backup files into S3. We track the multipart upload ID during this so that if we crash or in some other way orphan the upload we can abort it later on, in order to not take up space in S3 (you get charged for parts in a multipart upload that haven't been completed).

      For GCP they do not expose this, so we have to upload multiple objects and then join them together to get the same functionality. We do not clean these up however.

      What is the fix?
      Find a way to clean up these temporary objects if the upload is interrupted

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            owend Daniel Owen
            Matt.Hall Matt Hall
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty