Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-27804

Native Cloud Backup Support S3

    XMLWordPrintable

Details

    • Tools: Cloud Support

    Description

      One approach to backup in the cloud is to enable snapshotting. However, this is extremely expensive and doesn't provide differential backups.

      A more functionally rich approach would be to support native integrations to AWS S3, Azure blob storage and GCP blob storage for cheap backup. Other storage mediums could be investigated too.

      In such a scenario a user might provide credentials for the cloud backup target and the product would automatically backup according to a schedule. Other approaches are possible as well.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            ben.lackey Ben Lackey (Inactive) created issue -
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Field Original Value New Value
            Fix Version/s Mad-Hatter [ 15037 ]

            I see this just got assigned to Mike Wiederhold [X]. This isn't a Kubernetes specific thing, but a Server question. Should this belong to Anil Kumar?

            ben.lackey Ben Lackey (Inactive) added a comment - I see this just got assigned to Mike Wiederhold [X] . This isn't a Kubernetes specific thing, but a Server question. Should this belong to Anil Kumar ?

            This feature has come up a few times in the past. It's possible it might get scheduled for the Mad-Hatter release, but we have not done planning yet and I don't expect to do any planning until at least March.

            mikew Mike Wiederhold [X] (Inactive) added a comment - This feature has come up a few times in the past. It's possible it might get scheduled for the Mad-Hatter release, but we have not done planning yet and I don't expect to do any planning until at least March.
            pvarley Patrick Varley made changes -
            Component/s tools [ 10223 ]
            Component/s backup [ 12517 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s Alice [ 15048 ]
            Fix Version/s Mad-Hatter [ 15037 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s Mad-Hatter [ 15037 ]
            Fix Version/s Alice [ 15048 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s feature-backlog [ 10342 ]
            Fix Version/s Mad-Hatter [ 15037 ]
            malarky Chris Malarky made changes -
            Link This issue blocks CBSE-6235 [ CBSE-6235 ]
            chaitra.ramarao Chaitra Ramarao (Inactive) made changes -
            Assignee Mike Wiederhold [X] [ mikew ] Chaitra Ramarao [ chaitra.ramarao ]
            douglas.bonser Douglas Bonser (Inactive) made changes -
            Link This issue blocks CBSE-6746 [ CBSE-6746 ]
            douglas.bonser Douglas Bonser (Inactive) made changes -
            Link This issue blocks CBSE-6774 [ CBSE-6774 ]
            chaitra.ramarao Chaitra Ramarao (Inactive) made changes -
            Labels candidate-for-cheshirecat
            chaitra.ramarao Chaitra Ramarao (Inactive) made changes -
            Fix Version/s Cheshire-Cat [ 15915 ]
            Fix Version/s feature-backlog [ 10342 ]
            pvarley Patrick Varley made changes -
            Link This issue blocks CBSE-4438 [ CBSE-4438 ]
            pvarley Patrick Varley made changes -
            Link This issue is duplicated by MB-20244 [ MB-20244 ]
            pvarley Patrick Varley made changes -
            Link This issue blocks CBSE-7329 [ CBSE-7329 ]
            roi.katz Roi Katz made changes -
            Link This issue blocks CBSE-7460 [ CBSE-7460 ]
            roi.katz Roi Katz made changes -
            Link This issue blocks CBSE-7461 [ CBSE-7461 ]
            roi.katz Roi Katz made changes -
            Link This issue blocks CBSE-7462 [ CBSE-7462 ]
            roi.katz Roi Katz made changes -
            Link This issue blocks CBSE-7463 [ CBSE-7463 ]
            pvarley Patrick Varley made changes -
            Link This issue blocks CBSE-6611 [ CBSE-6611 ]
            pvarley Patrick Varley made changes -
            Assignee Chaitra Ramarao [ chaitra.ramarao ] James Lee [ james.lee ]
            pvarley Patrick Varley made changes -
            Issue Type Improvement [ 4 ] Epic [ 5 ]
            pvarley Patrick Varley made changes -
            Epic Name cbbackupmgr object store support
            pvarley Patrick Varley made changes -
            Epic Child MB-37130 [ 115594 ]
            pvarley Patrick Varley made changes -
            Link This issue is duplicated by MB-37129 [ MB-37129 ]
            akshay.rajendra Akshay Rajendra made changes -
            Link This issue backports to CBSE-7761 [ CBSE-7761 ]
            pvarley Patrick Varley made changes -
            Link This issue backports to CBSE-7761 [ CBSE-7761 ]
            pvarley Patrick Varley made changes -
            Link This issue blocks CBSE-7761 [ CBSE-7761 ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Epic Child MB-37414 [ 117135 ]
            james.lee James Lee made changes -
            Epic Child MB-37653 [ 118549 ]
            james.lee James Lee made changes -
            Epic Child MB-37654 [ 118550 ]
            james.lee James Lee made changes -
            Epic Child MB-37655 [ 118551 ]
            james.lee James Lee made changes -
            Epic Child MB-37657 [ 118554 ]
            james.lee James Lee made changes -
            Epic Child MB-37673 [ 118646 ]
            james.lee James Lee made changes -
            Epic Child MB-37683 [ 118682 ]
            james.lee James Lee made changes -
            Epic Child MB-37694 [ 118766 ]
            james.lee James Lee made changes -
            Epic Child MB-37697 [ 118775 ]
            james.lee James Lee made changes -
            Epic Child MB-37698 [ 118776 ]
            james.lee James Lee made changes -
            Epic Child MB-37752 [ 119022 ]
            james.lee James Lee made changes -
            Epic Child MB-37780 [ 119140 ]
            james.lee James Lee made changes -
            Epic Child MB-37793 [ 119224 ]
            james.lee James Lee made changes -
            Epic Child MB-37847 [ 119577 ]
            james.lee James Lee made changes -
            Epic Child MB-38014 [ 120988 ]
            james.lee James Lee made changes -
            Epic Child MB-38051 [ 121216 ]
            james.lee James Lee made changes -
            Epic Child MB-38052 [ 121223 ]
            james.lee James Lee made changes -
            Epic Child MB-38054 [ 121230 ]
            james.lee James Lee made changes -
            Epic Child MB-38056 [ 121251 ]
            james.lee James Lee made changes -
            Epic Child MB-38071 [ 121358 ]
            james.lee James Lee made changes -
            Epic Child MB-38072 [ 121359 ]
            james.lee James Lee made changes -
            Epic Child MB-38094 [ 121492 ]
            james.lee James Lee made changes -
            Epic Child MB-38113 [ 121619 ]
            james.lee James Lee made changes -
            Epic Child MB-38114 [ 121620 ]
            james.lee James Lee made changes -
            Epic Child MB-38188 [ 122069 ]
            ianmccloy Ian McCloy made changes -
            Link This issue blocks CBSE-8052 [ CBSE-8052 ]
            james.lee James Lee made changes -
            Epic Child MB-38239 [ 122355 ]
            james.lee James Lee made changes -
            Epic Child MB-38250 [ 122417 ]
            james.lee James Lee made changes -
            Epic Child MB-38254 [ 122427 ]
            owend Daniel Owen made changes -
            Epic Child MB-27550 [ 78281 ]
            owend Daniel Owen made changes -
            Epic Name cbbackupmgr object store support Tools: Cloud Support
            anil Anil Kumar (Inactive) made changes -
            Resolution Duplicate [ 3 ]
            Status Open [ 1 ] Resolved [ 5 ]
            james.lee James Lee added a comment -

            Hi Arunkumar Senthilnathan,

            I'm not sure why this was closed as a duplicate, there are still plenty of MB's related to this epic which require work and MB-38071 is just one of them.

            james.lee James Lee added a comment - Hi Arunkumar Senthilnathan , I'm not sure why this was closed as a duplicate, there are still plenty of MB's related to this epic which require work and MB-38071 is just one of them.
            james.lee James Lee made changes -
            Resolution Duplicate [ 3 ]
            Status Resolved [ 5 ] Reopened [ 4 ]

            James Lee I think it was Anil Kumar who closed this - but yeah you are right - this needs to be open until related issues are closed

            arunkumar Arunkumar Senthilnathan added a comment - James Lee I think it was Anil Kumar who closed this - but yeah you are right - this needs to be open until related issues are closed
            james.lee James Lee added a comment -

            Hi Arunkumar Senthilnathan,

            My apologies, it's obvious this was first thing in the morning. Yes this was my thoughts exactly.

            james.lee James Lee added a comment - Hi Arunkumar Senthilnathan , My apologies, it's obvious this was first thing in the morning. Yes this was my thoughts exactly.
            pvarley Patrick Varley made changes -
            Remote Link This issue links to "PRD (Web Link)" [ 19452 ]
            pvarley Patrick Varley made changes -
            Remote Link This issue links to "Design Doc (Web Link)" [ 19457 ]
            pvarley Patrick Varley made changes -
            Link This issue blocks CBSE-8216 [ CBSE-8216 ]
            james.lee James Lee made changes -
            Epic Child MB-38797 [ 125463 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-34608 [ 105206 ]
            owend Daniel Owen made changes -
            Labels candidate-for-cheshirecat approved-for-6.6.0
            james.lee James Lee made changes -
            Epic Child MB-38839 [ 125691 ]
            james.lee James Lee made changes -
            Epic Child MB-38840 [ 125692 ]
            owend Daniel Owen made changes -
            Epic Child MB-37657 [ 118554 ]
            james.lee James Lee made changes -
            Epic Child MB-38503 [ 123878 ]
            james.lee James Lee made changes -
            Epic Child MB-38941 [ 126136 ]
            james.lee James Lee made changes -
            Epic Child MB-38662 [ 124734 ]
            owend Daniel Owen made changes -
            Epic Child MB-37697 [ 118775 ]
            owend Daniel Owen made changes -
            Epic Child MB-37698 [ 118776 ]
            james.lee James Lee made changes -
            Epic Child MB-38969 [ 126255 ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Remote Link This issue links to "Design Document (Web Link)" [ 19557 ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Remote Link This issue links to "Design Document (Web Link)" [ 19557 ]
            james.lee James Lee made changes -
            Epic Child MB-38990 [ 126354 ]
            james.lee James Lee made changes -
            Epic Child MB-38991 [ 126355 ]
            james.lee James Lee made changes -
            Epic Child MB-38992 [ 126356 ]
            james.lee James Lee made changes -
            Epic Child MB-38993 [ 126357 ]
            james.lee James Lee made changes -
            Epic Child MB-38994 [ 126358 ]
            james.lee James Lee made changes -
            Epic Child MB-39040 [ 126633 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38282 [ 122605 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38299 [ 122719 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38247 [ 122413 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38110 [ 121597 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37791 [ 119208 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-36722 [ 113758 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37844 [ 119563 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38295 [ 122688 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38100 [ 121519 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38260 [ 122453 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37830 [ 119482 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-33647 [ 100873 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37779 [ 119136 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38099 [ 121518 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37805 [ 119301 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-35570 [ 108959 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-34397 [ 104151 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38215 [ 122180 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37504 [ 117692 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37575 [ 118024 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37721 [ 118888 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37547 [ 117920 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37644 [ 118460 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37539 [ 117900 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-38350 [ 123057 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37766 [ 119087 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37574 [ 118018 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37712 [ 118837 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37578 [ 118034 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37572 [ 117999 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-37543 [ 117914 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-28448 [ 80855 ]
            james.lee James Lee made changes -
            Epic Child MB-38189 [ 122072 ]
            james.lee James Lee made changes -
            Epic Child MB-38831 [ 125570 ]
            james.lee James Lee made changes -
            Epic Child MB-38251 [ 122419 ]
            james.lee James Lee made changes -
            Epic Child MB-38275 [ 122535 ]
            james.lee James Lee made changes -
            Epic Child MB-38076 [ 121388 ]
            james.lee James Lee made changes -
            Epic Child MB-38015 [ 120991 ]
            james.lee James Lee made changes -
            Epic Child MB-37835 [ 119520 ]
            james.lee James Lee made changes -
            Epic Child MB-38168 [ 121976 ]
            james.lee James Lee made changes -
            Epic Child MB-37784 [ 119150 ]
            james.lee James Lee made changes -
            Epic Child MB-37777 [ 119132 ]
            james.lee James Lee made changes -
            Epic Child MB-37620 [ 118335 ]
            james.lee James Lee made changes -
            Epic Child MB-37617 [ 118316 ]
            james.lee James Lee made changes -
            Epic Child MB-37502 [ 117671 ]
            james.lee James Lee made changes -
            Epic Child MB-37482 [ 117567 ]
            owend Daniel Owen made changes -
            Epic Child MB-37876 [ 119774 ]
            owend Daniel Owen made changes -
            Epic Child MB-38027 [ 121103 ]
            owend Daniel Owen made changes -
            Epic Child MB-37880 [ 119800 ]
            owend Daniel Owen made changes -
            Epic Child MB-37817 [ 119404 ]
            tin.tran Tin Tran made changes -
            Link This issue blocks CBSE-8294 [ CBSE-8294 ]
            chaitra.ramarao Chaitra Ramarao (Inactive) made changes -
            Fix Version/s 6.6.0 [ 16787 ]
            Fix Version/s Cheshire-Cat [ 15915 ]
            owend Daniel Owen made changes -
            Labels approved-for-6.6.0
            owend Daniel Owen made changes -
            Epic Child MB-34608 [ 105206 ]
            james.lee James Lee made changes -
            Epic Child MB-39112 [ 126860 ]
            james.lee James Lee made changes -
            Epic Child MB-39114 [ 126867 ]
            james.lee James Lee made changes -
            Epic Child MB-39115 [ 126868 ]
            james.lee James Lee made changes -
            Epic Child MB-39117 [ 126870 ]
            james.lee James Lee made changes -
            Epic Child MB-39118 [ 126872 ]
            james.lee James Lee made changes -
            Epic Child MB-39137 [ 126970 ]
            pvarley Patrick Varley made changes -
            Epic Child MB-39255 [ 127435 ]
            pvarley Patrick Varley made changes -
            Summary Native Cloud Backup Support Native Cloud Backup Support S3
            pvarley Patrick Varley made changes -
            Link This issue relates to MB-38944 [ MB-38944 ]
            pvarley Patrick Varley made changes -
            Remote Link This issue links to "Test plan (Web Link)" [ 19698 ]
            james.lee James Lee made changes -
            Epic Child MB-39329 [ 127730 ]
            james.lee James Lee made changes -
            Epic Child MB-39128 [ 126955 ]
            till Till Westmann made changes -
            Link This issue blocks MB-38724 [ MB-38724 ]
            james.lee James Lee made changes -
            Epic Child MB-39355 [ 127819 ]
            james.lee James Lee made changes -
            Epic Child MB-39356 [ 127821 ]
            james.lee James Lee made changes -
            Epic Child MB-39359 [ 127831 ]
            james.lee James Lee made changes -
            Epic Child MB-39413 [ 127957 ]
            james.lee James Lee made changes -
            Epic Child MB-39414 [ 127962 ]
            james.lee James Lee made changes -
            Epic Child MB-39418 [ 127996 ]
            owend Daniel Owen made changes -
            Epic Child MB-38254 [ 122427 ]
            owend Daniel Owen made changes -
            Epic Child MB-39147 [ 126998 ]
            owend Daniel Owen made changes -
            Labels approved-for-6.6.0
            owend Daniel Owen made changes -
            Epic Child MB-38351 [ 123059 ]
            james.lee James Lee made changes -
            Epic Child MB-39434 [ 128170 ]
            james.lee James Lee made changes -
            Epic Child MB-39455 [ 128289 ]
            james.lee James Lee made changes -
            Epic Child MB-39455 [ 128289 ]
            owend Daniel Owen made changes -
            Epic Child MB-39130 [ 126957 ]
            james.lee James Lee made changes -
            Epic Child MB-39465 [ 128362 ]
            owend Daniel Owen made changes -
            Epic Child MB-39455 [ 128289 ]
            james.lee James Lee made changes -
            Epic Child MB-39529 [ 128666 ]
            james.lee James Lee made changes -
            Epic Child MB-39540 [ 128757 ]
            james.lee James Lee made changes -
            Epic Child MB-39575 [ 129083 ]
            james.lee James Lee made changes -
            Epic Child MB-39607 [ 129183 ]
            james.lee James Lee made changes -
            Epic Child MB-39611 [ 129187 ]
            james.lee James Lee made changes -
            Epic Child MB-39616 [ 129198 ]
            james.lee James Lee made changes -
            Epic Child MB-39617 [ 129203 ]
            james.lee James Lee made changes -
            Epic Child MB-39619 [ 129215 ]
            james.lee James Lee made changes -
            Epic Child MB-39622 [ 129221 ]
            james.lee James Lee made changes -
            Epic Child MB-39640 [ 129307 ]
            james.lee James Lee made changes -
            Epic Child MB-39651 [ 129375 ]
            james.lee James Lee made changes -
            Epic Child MB-39697 [ 129800 ]
            james.lee James Lee made changes -
            Epic Child MB-39704 [ 129933 ]
            james.lee James Lee made changes -
            Epic Child MB-39719 [ 129983 ]
            james.lee James Lee made changes -
            Epic Child MB-39781 [ 130268 ]

            Build couchbase-server-6.6.0-7769 contains couchbase-cli commit ca2cb23 with commit message:
            MB-27804 Move cb-non-package-installer to Python3

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.0-7769 contains couchbase-cli commit ca2cb23 with commit message: MB-27804 Move cb-non-package-installer to Python3
            owend Daniel Owen made changes -
            Assignee James Lee [ james.lee ] Daniel Owen [ owend ]
            Resolution Done [ 6 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            owend Daniel Owen made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            james.lee James Lee made changes -
            Epic Child MB-40011 [ 131385 ]

            Build couchbase-server-7.0.0-2503 contains couchbase-cli commit ca2cb23 with commit message:
            MB-27804 Move cb-non-package-installer to Python3

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-2503 contains couchbase-cli commit ca2cb23 with commit message: MB-27804 Move cb-non-package-installer to Python3
            pvarley Patrick Varley made changes -
            Link This issue relates to MB-39003 [ MB-39003 ]
            owend Daniel Owen made changes -
            Link This issue relates to MB-42734 [ MB-42734 ]

            People

              owend Daniel Owen
              ben.lackey Ben Lackey (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty