Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60820

[CBM] Backing up to cloud should reuse buffers to lower GC churn

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • backlog
    • 7.6.0
    • no-doc, tools
    • 0

    Description

      What is the problem?
      In a customer case we saw very high memory usage when backing up to S3 with lots of threads and lots of KV nodes. After some investigation we found that when there are a lot of vBuckets streamed at once to S3 the memory profile becomes dominated by riftAllocateObjstoreBuffer and that GC starts freeing a lot of garbage.

      Further investigation was inconclusive but I have a feeling we are putting a lot of pressure on the GC with these buffers.

      What is the solution?
      We should see whether reusing the buffers improves the memory usage. This could be done using a Pool

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-60820
          # Subject Branch Project Status CR V

          Activity

            People

              owend Daniel Owen
              Matt.Hall Matt Hall
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty