Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-39302

Make file descriptor limits for storage backends dynamic

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Morpheus
    • Cheshire-Cat
    • couchbase-bucket
    • None

    Description

      See MB-36379. We have an MVP solution in which we set file descriptor limits at bucket initialization to some limit that will never increase/decrease based on the remaining file descriptors available. One issue here is that each backen takes an equal proportion of the file descriptors which is non-optimal and means that we pay a cost for the existence of couchstore/magma Buckets even if we don't use them.

      Would like to improve this so that the storage backends can take the remaining file descriptors after the front end takes the amount required for configured connections. We could then utilize all file descriptors if we have only a single storage backend present.

      This requires a bunch of thought in regards to what we do if we have to decrease file descriptor limits. We may have to things such as wait for flushes to complete, cancel/wait for backfills to complete (this could take hours-days for massive use cases).

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              owend Daniel Owen
              ben.huddleston Ben Huddleston
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty