Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60820

[CBM] Backing up to cloud should reuse buffers to lower GC churn

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Morpheus
    • 7.6.0
    • no-doc, tools
    • 0

    Description

      What is the problem?
      In a customer case we saw very high memory usage when backing up to S3 with lots of threads and lots of KV nodes. After some investigation we found that when there are a lot of vBuckets streamed at once to S3 the memory profile becomes dominated by riftAllocateObjstoreBuffer and that GC starts freeing a lot of garbage.

      Further investigation was inconclusive but I have a feeling we are putting a lot of pressure on the GC with these buffers.

      What is the solution?
      We should see whether reusing the buffers improves the memory usage. This could be done using a Pool

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            owend Daniel Owen
            Matt.Hall Matt Hall
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty