Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48038

Improve ability of checkpoint memory recovery

    XMLWordPrintable

Details

    Description

      There are a number of small changes that we need to put in for making memory recovery from checkpoints more effective. I use this MB for tracking them all.
      Current list:

      • MB-47386 now allows to increase the max num of checkpoints from 2 to a much higher number
      • Triggers for when creating a new checkpoint needs to be adjusted - for example, currently we trigger checkpoint creation based on max num of items for a checkpoint (defaulted to 10k), while a mem-usage related metric would certainly be more appropriate
      • Consider removing call to VBucketMap::getVBucketsSortedByChkMgrMem from CheckpointRemover - call is O(N) in the size of the VBMap
      • The order on how we attempt mem-recovery is currently expel->cursor_drop->ckpt_rem, while we should first try cktp_rem as some checkpoints may be eligible for removal even without dropping any cursor

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            paolo.cocchi Paolo Cocchi
            paolo.cocchi Paolo Cocchi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty