Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-2722

Add Azure blob storage support for backup/restore

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • kraken
    • operator-backup
    • 31: Get Crackin on Kraken, 1 - Crack-a-lackin on Kraken, 2 - Uncle Kracken, 3 - Krack the whip
    • 3

    Description

      Support for Azure for Couchbase Server backups is added in MB-39003.

      We need the corresponding functionality to allow Operator backups to work with Azure blob storage (similar to how GCP support for Operator backups is tracked in K8S-2527).

       

       

      Attachments

        Issue Links

          depends on

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MB-39003 Native Cloud Backup Support Azure

          • Major - Major loss of function.
          • Closed
          has to be started together with

          Improvement - An improvement or enhancement to an existing feature or task. K8S-2527 Add GCP Blobstore support for backup/restore

          • Major - Major loss of function.
          • Resolved
          relates to

          Task - A task that needs to be done. K8S-2975 Support Training - Backup Improvements

          • Major - Major loss of function.
          • Open

          Page - A new page either standalone or within a series of pages must be added K8S-2936 Operator: Docs for cloud backup improvements

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. K8S-2102 Supporting off-site/off-cluster backup with Operator

          • Major - Major loss of function.
          • Resolved
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Ascending order - Click to sort in descending order
            sciornei_amdocs Seb added a comment -

            same like AWS is supported OutOftheBox, from CAO.

            sciornei_amdocs Seb added a comment - same like AWS is supported OutOftheBox, from CAO.
            malarky Chris Malarky added a comment -

            Note that Azure Blob Storage in cbbackupmgr is GA-ing with Couchbase Server 7.1.2, so the operator-backup image will need to be updated to include that version.

            malarky Chris Malarky added a comment - Note that Azure Blob Storage in cbbackupmgr is GA-ing with Couchbase Server 7.1.2, so the operator-backup image will need to be updated to include that version.
            sciornei_amdocs Seb added a comment -

            Chris Malarky : thank you for mentioning it.
            Now, that we have https://issues.couchbase.com/browse/MB-45620 ready for 7.1.2, will upcoming CAO 2.4 support backup to Azure Blob storage?

            sciornei_amdocs Seb added a comment - Chris Malarky : thank you for mentioning it. Now, that we have https://issues.couchbase.com/browse/MB-45620 ready for 7.1.2, will upcoming CAO 2.4 support backup to Azure Blob storage?
            malarky Chris Malarky added a comment -

            Hi Seb,

            Yes, we are targeting this for CAO 2.4.

            Thanks,
            Chris

            malarky Chris Malarky added a comment - Hi Seb , Yes, we are targeting this for CAO 2.4. Thanks, Chris
            build-team Couchbase Build Team added a comment -

            Build couchbase-operator-backup-1.3.2-102 contains couchbase-operator-backup commit 82b2727 with commit message:
            K8S-2722: Support for backup to Azure

            build-team Couchbase Build Team added a comment - Build couchbase-operator-backup-1.3.2-102 contains couchbase-operator-backup commit 82b2727 with commit message: K8S-2722 : Support for backup to Azure
            build-team Couchbase Build Team added a comment -

            Build couchbase-operator-2.4.0-132 contains couchbase-operator commit 1204b5c with commit message:
            K8S-2722: Support for backup to Azure

            build-team Couchbase Build Team added a comment - Build couchbase-operator-2.4.0-132 contains couchbase-operator commit 1204b5c with commit message: K8S-2722 : Support for backup to Azure
            sciornei_amdocs Seb added a comment -

            Please confirm if azure blob auth. will work with workload identity and/or AAD pod identity. Is so, we will require the option to set the labels (and annotations) used by the backup pod: https://issues.couchbase.com/browse/K8S-2838?focusedCommentId=636403&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-636403 

            sciornei_amdocs Seb added a comment - Please confirm if azure blob auth. will work with workload identity and/or AAD pod identity. Is so, we will require the option to set the labels (and annotations) used by the backup pod:  https://issues.couchbase.com/browse/K8S-2838?focusedCommentId=636403&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-636403  
            Alex.emery Alex Emery added a comment -

            Seb we've investigated using backup with workload identity, and unfortunately, since workload identity is in preview the required support hasn't made it into Azure's golang SDK.

            We have the change for allowing labels/annotations and when Azure updates their SDK we can look at updating backup to support it.

            Alex.emery Alex Emery added a comment - Seb we've investigated using backup with workload identity, and unfortunately, since workload identity is in preview the required support hasn't made it into Azure's golang SDK. We have the change for allowing labels/annotations and when Azure updates their SDK we can look at updating backup to support it.
            sciornei_amdocs Seb added a comment - - edited

            Thank you Alex Emery . Indeed, both "newer" workload identity and the "older" pod identity are in preview.

            Do you expect any code changes, or should we adopt a new cb backup version for that to work, or it will be transparent (only add labels/annotations)?
            Thank you for the preparations in https://issues.couchbase.com/browse/K8S-2890 

            sciornei_amdocs Seb added a comment - - edited Thank you Alex Emery . Indeed, both "newer" workload identity and the "older" pod identity are in preview. Do you expect any code changes, or should we adopt a new cb backup version for that to work, or it will be transparent (only add labels/annotations)? Thank you for the preparations in https://issues.couchbase.com/browse/K8S-2890  
            Alex.emery Alex Emery added a comment -

            Seb when Azure updates their SDK we will need to make code changes to use the new version and release a new cb backup version first.

            Alex.emery Alex Emery added a comment - Seb when Azure updates their SDK we will need to make code changes to use the new version and release a new cb backup version first.

            People

              Alex.emery Alex Emery
              callum.majumdar Callum Majumdar
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty