Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7459

Warmup completed without loading any data, 0% resident ratio afterwards

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0, 2.0.1
    • Fix Version/s: 2.1.0
    • Component/s: couchbase-bucket
    • Security Level: Public
    • Labels:
      None
    • Environment:
      amazonaws + 6 nodes

      Description

      After warmup all nodes and re-replication one of nodes reported 0% resident ratio right after warmup.
      The log suggested that the warmup completed right after the phase 1 (key dump) for mem_use > low_water_mark, however, memstat indicated this wasn't the case. The total mem use at the time of warmup was about 45% of the high water mark (max data size).

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ep-engine-2-0 #475 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/475/)
        MB-7459 should count expired items during warmup (Revision d577556632ef440310290c944a1aac478e5aa4a8)

        Result = SUCCESS
        Jin :
        Files :

        • docs/stats.org
        • src/stats.hh
        • src/warmup.cc
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #475 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/475/ ) MB-7459 should count expired items during warmup (Revision d577556632ef440310290c944a1aac478e5aa4a8) Result = SUCCESS Jin : Files : docs/stats.org src/stats.hh src/warmup.cc
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ep-engine-2-0 #477 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/477/)
        MB-7459 should count expired items during warmup (Revision d577556632ef440310290c944a1aac478e5aa4a8)

        Result = SUCCESS
        Jin :
        Files :

        • docs/stats.org
        • src/warmup.cc
        • src/stats.hh
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #477 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/477/ ) MB-7459 should count expired items during warmup (Revision d577556632ef440310290c944a1aac478e5aa4a8) Result = SUCCESS Jin : Files : docs/stats.org src/warmup.cc src/stats.hh
        Hide
        maria Maria McDuff (Inactive) added a comment -

        chisheng, pls verify in 2.0.2. thanks.

        Show
        maria Maria McDuff (Inactive) added a comment - chisheng, pls verify in 2.0.2. thanks.
        Hide
        Chisheng Chisheng Hong (Inactive) added a comment -

        Verify with build 2.0.2-807-rel on a week long run KV cluster.
        Before rebooting all the nodes in cluster, default bucket 160M items, 20% resident, saslbucket 70M items, 39% resident.

        For saslbucket:
        After rebooting all the nodes and warmup finished, resident ratio drops, from 39% to 25% , and resident for each node is non-zero, range from 31% to 17%.
        All 70M items came back.

        For default:
        resident drops from 20% to 16%, resident for each node is non-zero, range from 10% to 19%
        All 160M items came back.

        Show
        Chisheng Chisheng Hong (Inactive) added a comment - Verify with build 2.0.2-807-rel on a week long run KV cluster. Before rebooting all the nodes in cluster, default bucket 160M items, 20% resident, saslbucket 70M items, 39% resident. For saslbucket: After rebooting all the nodes and warmup finished, resident ratio drops, from 39% to 25% , and resident for each node is non-zero, range from 31% to 17%. All 70M items came back. For default: resident drops from 20% to 16%, resident for each node is non-zero, range from 10% to 19% All 160M items came back.
        Hide
        Chisheng Chisheng Hong (Inactive) added a comment -

        The above resident ratio is active resident ratio. I also check the replica resident ratio, also looks fine.

        Show
        Chisheng Chisheng Hong (Inactive) added a comment - The above resident ratio is active resident ratio. I also check the replica resident ratio, also looks fine.

          People

          • Assignee:
            Chisheng Chisheng Hong (Inactive)
            Reporter:
            jin Jin Lim (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes