Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-51167

[CBM] The effect of synchronous backfill are not seen with PiTR enabled backups

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Critical
    • Morpheus
    • Morpheus
    • tools
    • None
    • Untriaged
    • 1
    • No

    Description

      What's the issue?
      First of all, synchronous backfill was introduced for backup to S3 to avoid streaming all 1024 vBuckets at once (but retain similar/the same consistency guarantees).

      Second, PiTR doesn't stream all snapshots in a single DCP stream; we re-request the next DCP stream for each PiTR snapshot.

      Streaming each snapshot separately will negate the benefits of synchronous backfill because all 1024 vBuckets will be streaming at once again.

      This causes a couple of major problems:
      1) We lose the performance benefit of synchronous backfill when using PiTR
      2) We lose the memory benefit for backup to S3 (the reason we initially added synchronous backfill)
      3) It means the progress bar is broken for PiTR aware backups

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              james.lee James Lee
              james.lee James Lee
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty