Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46490

[BP MB-47446] More memory overhead for non-collection index

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      In CC, each non-collection index will use 4M of write buffer. This is more than 2M used in MH. For large number of indexes with small boxes, this may be an issue.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build couchbase-server-7.0.1-6001 contains indexing commit 5951834 with commit message:
            MB-46490 [BP]: Change plasma dedicated instance recovery log flush buffer size to 256K

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-6001 contains indexing commit 5951834 with commit message: MB-46490 [BP] : Change plasma dedicated instance recovery log flush buffer size to 256K

            Build couchbase-server-7.0.1-6001 contains indexing commit 510031f with commit message:
            MB-46490 [BP]: Add configs for plasma flush buffer size

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-6001 contains indexing commit 510031f with commit message: MB-46490 [BP] : Add configs for plasma flush buffer size

            Ritam Sharma, the fix will impact performance and memory usage. Will monitor showfast for next 7.0.1 run to validate perf impact. For memory usage, the validation steps are:
            1) Create bucket with no data.
            2) Create 500 indexes on bucket (not on collection).
            3) Check indexer memory usage.
            4) Repeat steps 1-3 with and without fix and validate that memory usage has reduced with fix.

            akhil.mundroy Akhil Mundroy added a comment - Ritam Sharma , the fix will impact performance and memory usage. Will monitor showfast for next 7.0.1 run to validate perf impact. For memory usage, the validation steps are: 1) Create bucket with no data. 2) Create 500 indexes on bucket (not on collection). 3) Check indexer memory usage. 4) Repeat steps 1-3 with and without fix and validate that memory usage has reduced with fix.

            Akhil Mundroy Please find the numbers

            Stat 7.0.0-5302 7.0.2-6644
            memory_quota 4823449600, 4600MB 4823449600, 4600MB
            memory_used  5134680064, 4900MB  3336878080, 3182MB
            memory_used_storage 1048576, 1024KB  1048576, 1024KB
            memory_total_storage  24489984, 23MB  10727424, 10MB
            num_indexes  500 500
            logs  http://supportal.couchbase.com/snapshot/d 5f0f6754862f84ee80ffcc17d64b707::0  http://supportal.couchbase.com/snapshot/80bc5e4371bdfa2a0efda13c6833850a::0  
            vikas.chaudhary Vikas Chaudhary added a comment - Akhil Mundroy  Please find the numbers Stat 7.0.0-5302 7.0.2-6644 memory_quota 4823449600, 4600MB 4823449600, 4600MB memory_used  5134680064, 4900MB  3336878080, 3182MB memory_used_storage 1048576, 1024KB  1048576, 1024KB memory_total_storage  24489984, 23MB  10727424, 10MB num_indexes  500 500 logs   http://supportal.couchbase.com/snapshot/d 5f0f6754862f84ee80ffcc17d64b707::0   http://supportal.couchbase.com/snapshot/80bc5e4371bdfa2a0efda13c6833850a::0  

            Closing based on the discussion with Akhil

            vikas.chaudhary Vikas Chaudhary added a comment - Closing based on the discussion with Akhil

            People

              vikas.chaudhary Vikas Chaudhary
              jliang John Liang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty