Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4578

memory spike due to growing number of replica checkpoints if some of the nodes have slow disk write

    Details

      Description

      a solution proposed for this issue is to coalesce checkpoints in the replica side if number of open checkpoints is more than two

      https://github.com/membase/ep-engine/commit/dd4d60b79008586247e86c62e9ad2cc9320867d9

      fixed in branch-17 and is going to be given to users as hotfix as need basis

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        chiyoung Chiyoung Seo added a comment -

        We did several enhancements on the checkpoint datastructure to reduce the memory overhead.

        1) Collapse multiple checkpoints into a single one
        2) Each checkpoint item does not point to any Blob value instance anymore. Instead, it will always gets the latest value from memory hash table.
        3) Adapt the checkpoint item datastructure and reduce its memory overhead from 88 bytes to 40 bytes.

        Show
        chiyoung Chiyoung Seo added a comment - We did several enhancements on the checkpoint datastructure to reduce the memory overhead. 1) Collapse multiple checkpoints into a single one 2) Each checkpoint item does not point to any Blob value instance anymore. Instead, it will always gets the latest value from memory hash table. 3) Adapt the checkpoint item datastructure and reduce its memory overhead from 88 bytes to 40 bytes.
        Hide
        chiyoung Chiyoung Seo added a comment -

        It was already merged into 1.8 branch. The last 1.8 build that the QA team has been testing includes this fix.

        Show
        chiyoung Chiyoung Seo added a comment - It was already merged into 1.8 branch. The last 1.8 build that the QA team has been testing includes this fix.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        fixed but not merged yet to 1.8 branch

        Show
        farshid Farshid Ghods (Inactive) added a comment - fixed but not merged yet to 1.8 branch

          People

          • Assignee:
            chiyoung Chiyoung Seo
            Reporter:
            farshid Farshid Ghods (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes