Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6981

Beta 2.0 - high fragmentation levels on GAT operations

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • bug-backlog
    • 2.0-beta
    • storage-engine
    • Security Level: Public
    • None

    Description

      From here: http://www.couchbase.com/forums/thread/beta-2-0-high-fragmentation-levels-gat-operations

      Hi everyone,
      In our application we write fairly large K/V pairs - about 60Kbyte each. These are image chips. We set a fairly long TTL on these - 1 week.
      When we need a image chip we request it from Couchbase via a GAT operation. If it exists we re-set the TTL to 1 week with the goal to keep those chips access alive in the cache, and let the stale content expire.
      The problem we are seeing is that a GAT operation does not simply update the TTL in the metadata but causes the entire K/V (with new TTL) to be appended to the end of the disk file. This causes fragmentation to grow quite quickly of the document store, requiring lots of compactions to keep it in control.
      So my question is why does a TTL update (metadata) even require this to occur and is there a way to tune around this?
      Thanks

      We should be able to update just the meta-data for GAT, instead of rewriting the whole doc.

      Attachments

        For Gerrit Dashboard: MB-6981
        # Subject Branch Project Status CR V

        Activity

          People

            shivani.gupta Shivani Gupta
            damien damien (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty