Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61584

Magma seqIndex wasted space may consume all compression gains

    XMLWordPrintable

Details

    • Task
    • Resolution: Fixed
    • Major
    • Morpheus
    • None
    • storage-engine
    • 0
    • Fusion-April-25-2024, Fusion-May-2-2024

    Description

      We noticed in CBSE-16847 that the sequence index wasted space was consuming half the total disk usage on a single node, 1TB of 2TB. This was a result of high compression(2X) in this case resulting in wasted space being allowed to grow up to the 50% fragmentation compared to the total data_size thus negating the gains made by compression.

      The fix for this involves scaling WastedSpace usage during compaction trigger computation with compression ratio of L4 ie. logical size vs physical.

      We will also have to add stats to help debugging this scaling if issues arise.

      Attachments

        Issue Links

          Activity

            People

              apaar.gupta Apaar Gupta
              apaar.gupta Apaar Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty