Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4814

Checkpoint only needs to maintain keys and subset of meta data fields. ( memory optimization)

    Details

      Description

      The previous checkpoint implementation requires each checkpoint to maintain the list of keys, their values, and all of their meta data fields, which can cause very high memory overhead in case disk write throughput or replication is very slow.

      Based on various use cases for checkpoint, it turns out that it is not necessary to maintain the strong consistency across checkpoints. This can simplify a checkpoint's item structure, which allows us to have keys and subset of their meta data fields only. Basically, a checkpoint only contains the information about which keys have been mutated and their operation types.

      With this simplication, the memory overhead of a single checkpoint item (i.e., QueuedItem instance) is reduced from 88 bytes to 40 bytes. In addition, the closed checkpoint won't point to stale Blob value instances anymore.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        chiyoung Chiyoung Seo created issue -
        chiyoung Chiyoung Seo made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        dipti Dipti Borkar made changes -
        Fix Version/s 1.8.1 [ 10295 ]
        farshid Farshid Ghods (Inactive) made changes -
        Component/s couchbase-bucket [ 10173 ]
        Component/s ep_engine [ 10013 ]
        farshid Farshid Ghods (Inactive) made changes -
        Summary Checkpoint only needs to maintain keys and subset of meta data fields. Checkpoint only needs to maintain keys and subset of meta data fields. ( memory optimization)
        Labels 1.8.1-release-notes
        maria Maria McDuff (Inactive) made changes -
        Fix Version/s 2.0-beta [ 10113 ]
        Fix Version/s 1.8.2 [ 10249 ]
        Fix Version/s 1.8.1 [ 10295 ]

          People

          • Assignee:
            chiyoung Chiyoung Seo
            Reporter:
            chiyoung Chiyoung Seo
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 8h
              8h
              Remaining:
              Remaining Estimate - 8h
              8h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Gerrit Reviews

                There are no open Gerrit changes