Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7818

Warmup to continue if the initial access log is quite small or all expired

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.0
    • Fix Version/s: 2.2.0
    • Component/s: couchbase-bucket
    • Security Level: Public
    • Labels:
      None

      Description

      Under the current design EP Engine stops the warmup once after it finishing loading all items based on the access log. Unfortunately this could lead to Couchbase Server starting data access with very low resident ratio. This is because the access log could contain only very small set of persisted, active items or majority of items in the log got expired during the warmup.

      A betteer behavior of the warmup in the above case would be it continues to load data from disks upto the low memory watermark.

        Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          perry Perry Krug added a comment -

          Couchbase should still be able to provide opening of the service after a certain threshold, but continue to bulk load data from disk until the low watermark.

          Perhaps with our upcoming multi-reader support, this would be a matter of having a single thread (or set of threads) doing the bulk load while still having some threads available to do one-off background fetches from the client requests so as not to starve those during the backfill.

          Show
          perry Perry Krug added a comment - Couchbase should still be able to provide opening of the service after a certain threshold, but continue to bulk load data from disk until the low watermark. Perhaps with our upcoming multi-reader support, this would be a matter of having a single thread (or set of threads) doing the bulk load while still having some threads available to do one-off background fetches from the client requests so as not to starve those during the backfill.

            People

            • Assignee:
              jin Jin Lim (Inactive)
              Reporter:
              jin Jin Lim (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes