Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-38188

Cloud restore could use the Rift indexes to minimise the amount of data streamed from the cloud

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Done
    • Major
    • 6.6.0
    • 6.6.0
    • tools

    Description

      When doing a 'FullScan' from the Rift index we are given the start/end sequence numbers that we would like from this vBucket. The (local) binary data writer currently just opens the data store on a restore and discards the data it doesn't need from the buffered writer.

      We could be smarter about this (for cloud) by using the 'GetObjectRange' function to get an 'io.Reader' for only the data which we are going to restore.

      We could do the same for local restore, except we simply use 'Seek' to skip the first 'n' bytes.

      I doubt this will make a massive difference to the costing for restore since we will be reading almost all the data from the data stores anyway but it's definitely worth doing.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            james.lee James Lee
            james.lee James Lee
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty