Uploaded image for project: 'Couchbase Documentation'
  1. Couchbase Documentation
  2. DOC-4952

Increase documented bucket limit to 30

    XMLWordPrintable

Details

    • DOC-2019-S16-Aug09, DOC-2019-S18-Sep06
    • 1

    Description

      The current bucket limit of 10 is being increased to 30. Refer to MB-33410.

      This needs to be updated in the documentation at least on the following page (not sure if there are other pages as well):

      https://docs.couchbase.com/server/6.0/rest-api/rest-get-internal-setting.html

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            shivani.gupta Shivani Gupta created issue -
            tony.hillman Tony Hillman made changes -
            Field Original Value New Value
            Status Open [ 1 ] In Progress [ 3 ]
            tony.hillman Tony Hillman made changes -
            Actual Start 2019-03-25 10:40 (issue has been started)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S07-Apr05 [ 759 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-03-25 10:00 (started sprint)
            Planned Start 2019-03-25 10:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Due Date 03/May/19

            Tony Hillman there is slight scope increase in the requirements for this ticket. Along with documenting the new limit, we also want to clearly state certain guidelines when using high number of buckets. The guidelines are as follows:

            • Sizing has to account for raw CPU overhead of high number of buckets. It is recommended to set aside 0.4 core/bucket for rebalance to work smoothly. This overhead does not account for any front-end workload which must be sized separately.
            • Large number of indexes per bucket may cause issues when there are high number of buckets. It is recommended to stay below 10 indexes per bucket.
            • There are known issues with Eventing service and large number of buckets.
            • System limits for file descriptors and TCP-IP connections may be exceeded and should be adjusted.
            • Monitoring is recommended for CPU usage and System Limits

            Ian McCloy FYI.

            shivani.gupta Shivani Gupta added a comment - Tony Hillman there is slight scope increase in the requirements for this ticket. Along with documenting the new limit, we also want to clearly state certain guidelines when using high number of buckets. The guidelines are as follows: Sizing has to account for raw CPU overhead of high number of buckets. It is recommended to set aside 0.4 core/bucket for rebalance to work smoothly. This overhead does not account for any front-end workload which must be sized separately. Large number of indexes per bucket may cause issues when there are high number of buckets. It is recommended to stay below 10 indexes per bucket. There are known issues with Eventing service and large number of buckets. System limits for file descriptors and TCP-IP connections may be exceeded and should be adjusted. Monitoring is recommended for CPU usage and System Limits Ian McCloy FYI.
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S07-Apr05 [ 759 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S08-Apr19 [ 760 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-03-25 10:00 2019-04-08 06:00 (started sprint)
            Planned Start 2019-03-25 10:00 2019-04-08 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S08-Apr19 [ 760 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S09-May03 [ 761 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            shivani.gupta Shivani Gupta made changes -
            Link This issue blocks MB-32172 [ MB-32172 ]
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-04-08 06:00 2019-04-30 08:30 (started sprint)
            Planned Start 2019-04-08 06:00 2019-04-30 08:30 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S09-May03 [ 761 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S10-May17 [ 762 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-04-30 08:30 2019-05-06 06:00 (started sprint)
            Planned Start 2019-04-30 08:30 2019-05-06 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S10-May17 [ 762 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S11-May31 [ 763 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-05-06 06:00 2019-05-20 06:00 (started sprint)
            Planned Start 2019-05-06 06:00 2019-05-20 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S11-May31 [ 763 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S12-Jun14 [ 809 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-05-20 06:00 2019-06-03 06:00 (started sprint)
            Planned Start 2019-05-20 06:00 2019-06-03 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S12-Jun14 [ 809 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S13-Jun28 [ 810 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-06-03 06:00 2019-06-17 06:00 (started sprint)
            Planned Start 2019-06-03 06:00 2019-06-17 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S13-Jun28 [ 810 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S14-Jul12 [ 811 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-06-17 06:00 2019-07-01 06:00 (started sprint)
            Planned Start 2019-06-17 06:00 2019-07-01 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S14-Jul12 [ 811 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S15-Jul26 [ 812 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-07-01 06:00 2019-07-15 06:00 (started sprint)
            Planned Start 2019-07-01 06:00 2019-07-15 06:00 (started sprint)
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S15-Jul26 [ 812 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09 [ 813 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher

            Tony Hillman is this done? We need this fixed for the Beta.

            amarantha [X]?

            shivani.gupta Shivani Gupta added a comment - Tony Hillman is this done? We need this fixed for the Beta. amarantha [X] ?
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Remote Link This issue links to "Page (Couchbase, Inc. Wiki)" [ 18365 ]
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Planned End 2019-07-15 06:00 2019-08-09 16:30 (started sprint)
            Planned Start 2019-07-15 06:00 2019-08-09 16:30 (started sprint)
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Sprint DOC-2019-S16-Aug09 [ 813 ] DOC-2019-S16-Aug09, DOC-2019-S17-Aug23 [ 813, 814 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S17-Aug23 [ 813, 814 ] DOC-2019-S16-Aug09 [ 813 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09 [ 813 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S19-Sep20 [ 813, 815, 816 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S19-Sep20 [ 813, 815, 816 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S20-Oct04 [ 813, 815, 817 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S20-Oct04 [ 813, 815, 817 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S21-Oct18 [ 813, 815, 818 ]
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Rank Ranked lower
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S21-Oct18 [ 813, 815, 818 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S22-Nov01 [ 813, 815, 819 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S22-Nov01 [ 813, 815, 819 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ]
            tony.hillman Tony Hillman made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S23-Nov15 [ 813, 815, 820 ]
            tony.hillman Tony Hillman made changes -
            Rank Ranked higher
            shivani.gupta Shivani Gupta added a comment - - edited

            Adding "must-fix" for this ticket. amarantha [X] fyi.

             

            To simplify, we can state the following guidelines only:

            • Sizing has to account for raw CPU overhead of high number of buckets. It is recommended to set aside 0.4 core/bucket for rebalance to work smoothly. This overhead does not account for any front-end workload which must be sized separately.
            • Large number of indexes per bucket may cause issues when there are high number of buckets. 
            • Monitoring is recommended for CPU usage and System Limits

             

            shivani.gupta Shivani Gupta added a comment - - edited Adding "must-fix" for this ticket. amarantha [X]  fyi.   To simplify, we can state the following guidelines only: Sizing has to account for raw CPU overhead of high number of buckets. It is recommended to set aside 0.4 core/bucket for rebalance to work smoothly. This overhead does not account for any front-end workload which must be sized separately. Large number of indexes per bucket may cause issues when there are high number of buckets.  Monitoring is recommended for CPU usage and System Limits  
            shivani.gupta Shivani Gupta made changes -
            Labels high-bucket-density high-bucket-density must-fix
            simon.dew Simon Dew made changes -
            Sprint DOC-2019-S16-Aug09, DOC-2019-S18-Sep06, DOC-2019-S23-Nov15 [ 813, 815, 820 ] DOC-2019-S16-Aug09, DOC-2019-S18-Sep06 [ 813, 815 ]
            simon.dew Simon Dew made changes -
            Rank Ranked higher
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Fix Version/s 6.5 Milestone 1 [ 16654 ]
            brett19 Brett Lawson made changes -
            Story Points 1

            Amarantha Kulkarni / Tony Hillman do you have an ETA for getting this change in?

            malarky Chris Malarky added a comment - Amarantha Kulkarni / Tony Hillman do you have an ETA for getting this change in?

            Created a new ticket to track the addition of sizing guidelines - DOC-8454 (ETA 4/23/2021)

            Will resolve this ticket as the initial request to update the bucket limit to 30 has been completed.

            amarantha.kulkarni Amarantha Kulkarni (Inactive) added a comment - Created a new ticket to track the addition of sizing guidelines - DOC-8454 (ETA 4/23/2021) Will resolve this ticket as the initial request to update the bucket limit to 30 has been completed.
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Labels high-bucket-density must-fix high-bucket-density

            The initial task to document increased bucket limit has been completed. 

            Additional note to add sizing guidelines is being tracked in a separate ticket: DOC-8454 - Add sizing information to Server docs

            amarantha.kulkarni Amarantha Kulkarni (Inactive) added a comment - The initial task to document increased bucket limit has been completed.  Additional note to add sizing guidelines is being tracked in a separate ticket: DOC-8454 - Add sizing information to Server docs
            amarantha.kulkarni Amarantha Kulkarni (Inactive) made changes -
            Resolution Fixed [ 1 ]
            Status In Progress [ 3 ] Resolved [ 5 ]

            People

              tony.hillman Tony Hillman
              shivani.gupta Shivani Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty