Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7217

XDCR checkpoint interval does not provide optimal behavior for read heavy workloads

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0
    • Fix Version/s: 3.0
    • Component/s: XDCR
    • Security Level: Public
    • Labels:
      None

      Description

      XDCR has a default checkpoint interval of 30 minutes. Replication checkpoints are written when either of 2 conditions are satisfied:
      1. vBucket replicator takes longer than the checkpoint interval
      2. vBucket replicator determines that it has been longer than the checkpoint interval since the last checkpoint was written

      However, if you have a read-only dataset, checkpoints may never be written (initial replication finishes in less than 30 minutes, no mutations later to trigger 2nd rule).

      NOTE: it should be noted that this only results in additional meta-data being sent, not full documents

      In read-heavy (but not read-only) workloads the behavior may still not be optimal.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        maria Maria McDuff (Inactive) added a comment -

        marty, junyi,

        is this a must-fix? since it's minor, can we defer or will u ever fix this, junyi? if not, pls resolve as 'won't fix'.

        Show
        maria Maria McDuff (Inactive) added a comment - marty, junyi, is this a must-fix? since it's minor, can we defer or will u ever fix this, junyi? if not, pls resolve as 'won't fix'.
        Hide
        cihan Cihan Biyikoglu added a comment - - edited

        we should consider this improvement for future but not a must have for 3.0. suggest moving to feature backlog.

        Show
        cihan Cihan Biyikoglu added a comment - - edited we should consider this improvement for future but not a must have for 3.0. suggest moving to feature backlog.
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        http://review.couchbase.org/40482
        http://review.couchbase.org/40483

        implement settings for more frequent checkpointing. I've not touched our defaults.

        So we now allow for lowering checkpoint interval down to 10 seconds. And there's also setting (for destination side) that allows it to serve incoming checkpoint request without waiting for disk persistence.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - http://review.couchbase.org/40482 http://review.couchbase.org/40483 implement settings for more frequent checkpointing. I've not touched our defaults. So we now allow for lowering checkpoint interval down to 10 seconds. And there's also setting (for destination side) that allows it to serve incoming checkpoint request without waiting for disk persistence.

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            mschoch Marty Schoch
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes