Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46827

Limit the Checkpoint memory usage

    XMLWordPrintable

Details

    Description

      Currently checkpoints can take up to the entire bucket quota. That has a number of problematic side effects in DGM scenarios, eg Resident Ratio dropping to 0, high replica checkpoints memory usage contributing to replication live-locks, etc..

      It's important to highlight that capping the Checkpoint quota is expected to directly solve some existing issues (like the Resident Ratio one), but the same doesn't apply to other issues (like the DCP live-lock) where the high Checkpoint mem-usage is probably just one of the factors that contribute to the problem. Other factors are being investigated and addressed in dedicated MBs.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build couchbase-server-7.1.0-1091 contains kv_engine commit 084a46c with commit message:
            MB-46827: Introduce KVBucket::hasCapacityInCheckpoints()

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.1.0-1091 contains kv_engine commit 084a46c with commit message: MB-46827 : Introduce KVBucket::hasCapacityInCheckpoints()

            Build couchbase-server-7.1.0-1091 contains kv_engine commit cd05676 with commit message:
            MB-46827: Remove VBucketMap::getVBucketsTotalCheckpointMemoryUsage

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.1.0-1091 contains kv_engine commit cd05676 with commit message: MB-46827 : Remove VBucketMap::getVBucketsTotalCheckpointMemoryUsage

            Build couchbase-server-7.1.0-1130 contains kv_engine commit cb334fa with commit message:
            MB-46827: Introduce the new checkpoint memory recovery logic

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.1.0-1130 contains kv_engine commit cb334fa with commit message: MB-46827 : Introduce the new checkpoint memory recovery logic

            Build couchbase-server-7.1.0-1133 contains kv_engine commit 0e5ae2c with commit message:
            MB-46827: Remove cursor_dropping_checkpoint_mem_<lower/upper>_mark

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.1.0-1133 contains kv_engine commit 0e5ae2c with commit message: MB-46827 : Remove cursor_dropping_checkpoint_mem_<lower/upper>_mark
            paolo.cocchi Paolo Cocchi added a comment -

            Verified by unit tests.

            paolo.cocchi Paolo Cocchi added a comment - Verified by unit tests.

            People

              paolo.cocchi Paolo Cocchi
              paolo.cocchi Paolo Cocchi
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty