Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46490

[BP MB-47446] More memory overhead for non-collection index

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      In CC, each non-collection index will use 4M of write buffer. This is more than 2M used in MH. For large number of indexes with small boxes, this may be an issue.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            jliang John Liang created issue -
            srinath.duvuru Srinath Duvuru made changes -
            Field Original Value New Value
            Fix Version/s 7.0.1 [ 17104 ]
            Fix Version/s CheshireCat.Next [ 16908 ]
            srinath.duvuru Srinath Duvuru made changes -
            Assignee John Liang [ jliang ] Akhil Mundroy [ akhil.mundroy ]
            srinath.duvuru Srinath Duvuru made changes -
            Labels plasma ca plasma
            srinath.duvuru Srinath Duvuru made changes -
            Labels ca plasma plasma
            akhil.mundroy Akhil Mundroy made changes -
            Link This issue is cloned by MB-47446 [ MB-47446 ]
            akhil.mundroy Akhil Mundroy made changes -
            Summary More memory overhead for non-collection index [BP MB-47446] More memory overhead for non-collection index
            akhil.mundroy Akhil Mundroy made changes -
            Link This issue is a backport of MB-47446 [ MB-47446 ]
            akhil.mundroy Akhil Mundroy made changes -
            Link This issue is cloned by MB-47446 [ MB-47446 ]

            Wayne Siu. Please approve for 7.0.1. Thanks.

            srinath.duvuru Srinath Duvuru added a comment - Wayne Siu . Please approve for 7.0.1. Thanks.
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.2 [ 18012 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.1 [ 17104 ]
            ritam.sharma Ritam Sharma added a comment -

            Srinath Duvuru - QE will need detailed steps to validate the issue.

            ritam.sharma Ritam Sharma added a comment - Srinath Duvuru - QE will need detailed steps to validate the issue.

            Build couchbase-server-7.0.1-5997 contains plasma commit c968834 with commit message:
            MB-46490 [BP]: Split flush buffer size config for dedicated and shared log

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-5997 contains plasma commit c968834 with commit message: MB-46490 [BP] : Split flush buffer size config for dedicated and shared log

            Build couchbase-server-7.0.1-5997 contains plasma commit 331ecda with commit message:
            MB-46490 [BP]: Add separate config for recovery log flush buffer size

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-5997 contains plasma commit 331ecda with commit message: MB-46490 [BP] : Add separate config for recovery log flush buffer size

            Build couchbase-server-7.0.1-6001 contains indexing commit 5951834 with commit message:
            MB-46490 [BP]: Change plasma dedicated instance recovery log flush buffer size to 256K

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-6001 contains indexing commit 5951834 with commit message: MB-46490 [BP] : Change plasma dedicated instance recovery log flush buffer size to 256K

            Build couchbase-server-7.0.1-6001 contains indexing commit 510031f with commit message:
            MB-46490 [BP]: Add configs for plasma flush buffer size

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-6001 contains indexing commit 510031f with commit message: MB-46490 [BP] : Add configs for plasma flush buffer size

            Ritam Sharma, the fix will impact performance and memory usage. Will monitor showfast for next 7.0.1 run to validate perf impact. For memory usage, the validation steps are:
            1) Create bucket with no data.
            2) Create 500 indexes on bucket (not on collection).
            3) Check indexer memory usage.
            4) Repeat steps 1-3 with and without fix and validate that memory usage has reduced with fix.

            akhil.mundroy Akhil Mundroy added a comment - Ritam Sharma , the fix will impact performance and memory usage. Will monitor showfast for next 7.0.1 run to validate perf impact. For memory usage, the validation steps are: 1) Create bucket with no data. 2) Create 500 indexes on bucket (not on collection). 3) Check indexer memory usage. 4) Repeat steps 1-3 with and without fix and validate that memory usage has reduced with fix.
            wayne Wayne Siu made changes -
            Labels plasma approved-for-7.0.2 plasma
            wayne Wayne Siu made changes -
            Link This issue blocks MB-46308 [ MB-46308 ]
            akhil.mundroy Akhil Mundroy made changes -
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            ritam.sharma Ritam Sharma made changes -
            Labels approved-for-7.0.2 plasma approved-for-7.0.2 performance plasma
            wayne Wayne Siu made changes -
            Assignee Akhil Mundroy [ akhil.mundroy ] Vikas Chaudhary [ vikas.chaudhary ]

            Akhil Mundroy Please find the numbers

            Stat 7.0.0-5302 7.0.2-6644
            memory_quota 4823449600, 4600MB 4823449600, 4600MB
            memory_used  5134680064, 4900MB  3336878080, 3182MB
            memory_used_storage 1048576, 1024KB  1048576, 1024KB
            memory_total_storage  24489984, 23MB  10727424, 10MB
            num_indexes  500 500
            logs  http://supportal.couchbase.com/snapshot/d 5f0f6754862f84ee80ffcc17d64b707::0  http://supportal.couchbase.com/snapshot/80bc5e4371bdfa2a0efda13c6833850a::0  
            vikas.chaudhary Vikas Chaudhary added a comment - Akhil Mundroy  Please find the numbers Stat 7.0.0-5302 7.0.2-6644 memory_quota 4823449600, 4600MB 4823449600, 4600MB memory_used  5134680064, 4900MB  3336878080, 3182MB memory_used_storage 1048576, 1024KB  1048576, 1024KB memory_total_storage  24489984, 23MB  10727424, 10MB num_indexes  500 500 logs   http://supportal.couchbase.com/snapshot/d 5f0f6754862f84ee80ffcc17d64b707::0   http://supportal.couchbase.com/snapshot/80bc5e4371bdfa2a0efda13c6833850a::0  

            Closing based on the discussion with Akhil

            vikas.chaudhary Vikas Chaudhary added a comment - Closing based on the discussion with Akhil
            vikas.chaudhary Vikas Chaudhary made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              vikas.chaudhary Vikas Chaudhary
              jliang John Liang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty