Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-21575

Delta DCP

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • backlog
    • 4.5.0, 5.0.0
    • couchbase-bucket
    • None

    Description

      Capturing the feature request / performance enhancement.

      When it is more efficient (*) only send the difference rather than the entirety of the new document via DCP. For internal replication, this could reduce the volume of traffic between nodes and for external DCP clients, could reduce traffic externally too.

      (*) Empirical evidence is required to determine a heuristic for when it is more efficient but in general consider making a small update to a large document (e.g. appending a single byte to a 19MB doc), most sub-doc operations.

      Further considerations:

      • If doc is not resident on replica side, would require a bg fetch to construct entirety of document
      • Prior work has suggested this approach gives a larger benefit over DCP compression

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. MB-30182 DCP: Capture Partial Document Updates

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MB-11229 For pre/append operations DCP should only send the append chuck and not the whole document.

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Task - A task that needs to be done. MB-15662 Support DCP Producer side compression

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MB-14121 Enable datatype to allow writing compressed (snappy) documents

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-27089 Reduce write amplification for partial document updates

          • Major - Major loss of function.
          • Open
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              chinhong Chin Hong
              dhaikney David Haikney (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty