Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-51123

Tune the logic used by Magma to hold checkpoints for rollback

    XMLWordPrintable

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • Morpheus
    • storage-engine
    • 1

    Description

      Currently magma holds either 10min or 10% of overhead as a fraction of total data size as checkpoints which can be rolled back. The overhead is computed as the amount of extra data held on disk by the checkpoints due to SSTables being deleted and created by compaction. In higher write throughput workloads we have noticed this overhead computation is a bit aggressive and may need to be altered.

      We could also investigate kv_engine providing magma with a safe seqno upto which it holds checkpoints. This would avoid rollback to zero completely which can be very costly when the data size is in terabytes.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          There are no comments yet on this issue.

          People

            apaar.gupta Apaar Gupta
            apaar.gupta Apaar Gupta
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty