Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47810

Improve collection drop compaction batching

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Morpheus
    • 7.1.0
    • storage-engine

    Description

      For space reclamation after collection drop, magma-kvstore uses magma prefix compaction API to partially compact the kvstore data that belongs to a collection key prefix range.

      If the batch of collections to be dropped are large, key prefix compaction may internally rewrite the same data repeatedly and can take a long time (Prefix compaction works by finding the sstables which belong to the prefix and rewriting the sstables by excluding those ranges). Since we maintain some collection size heuristics, we can issue full compaction instead of prefix compaction when full compaction is efficient. For eg., if the list of collections to be dropped contributes to > 40% of the bucket size, a full compaction will be much more efficient as it needs to rewrite the data only once.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            scott.lashley Scott Lashley
            sarath Sarath Lakshman
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty