Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56954

Reduce memory overhead from TsVbuuid

    XMLWordPrintable

Details

    Description

      When mutations get queued up in indexer, there is a corresponding tsVbuuid generated every 5ms for bookkeeping and it gets queued up as well.

      The size of each TsVbuuid will be atleast 40KB for 1024 vbuckets. TsVbuuid can easily grow to 10k-20k, the memory allocated just for TsVbuuid comes to 400MB-800MB for a single bucket. Indexer allocates 90% of quota for storage and tries to limit the overheads to 10%. But with high memory allocation for TsVbuuid, storage needs to release some of its quota.

      Overhead of TsVbuuid data structure can be reduced by merging the queued up tsVbuuid when it goes beyond a threshold.

      This is specially helpful in small node configs.

      Attachments

        Issue Links

          backports to

          Improvement - An improvement or enhancement to an existing feature or task. MB-57777 [7.2.1 BP] - Reduce memory overhead from TsVbuuid

          • Major - Major loss of function.
          • Closed
          blocks

          Improvement - An improvement or enhancement to an existing feature or task. MB-57675 Control golang memory usage by indexer process

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-56538 [System Test] High indexer CPU usage over a period of 3+ hours with CDC enabled

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-56649 Improve queue control when indexer is under memory pressure

          • Major - Major loss of function.
          • Closed
          is blocked by

          AV-58958 Loading...

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              hemant.rajput Hemant Rajput
              deepkaran.salooja Deepkaran Salooja
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty