Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0
    • Fix Version/s: 2.0.1
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None
    # Subject Project Status CR V
    For Gerrit Dashboard: &For+MB-7354=message:MB-7354

      Activity

      Hide
      alkondratenko Aleksey Kondratenko (Inactive) added a comment - - edited

      Copying Mike's helpful explanation from hidden ticket:

      Alk,

      I have looked at this issue and similar issues and their are two issues here and one bug that I need you to fix on the ns_server side.

      The first issue here is that some of the XXX-use-case servers are heavily over loaded. In some of the logs I have looked at I saw over a 500k items in a lot of the checkpoint queues. As a result the server memory is overloaded and waiting to persist items to disk.

      The stat that is used by ns_server for the alerts is also no the correct stat. ep_overhead is use to keep track of the size of the checkpoint queues and other structures used by ep-engine. The correct stat to use (vb_active_meta_data + vb_replica_meta_data + vb_pending_meta_data). This should resolve the issue. Also, note that the issue of heavy checkpointing overhead will benefit greatly from having multiple writers in our next release.

      Show
      alkondratenko Aleksey Kondratenko (Inactive) added a comment - - edited Copying Mike's helpful explanation from hidden ticket: Alk, I have looked at this issue and similar issues and their are two issues here and one bug that I need you to fix on the ns_server side. The first issue here is that some of the XXX-use-case servers are heavily over loaded. In some of the logs I have looked at I saw over a 500k items in a lot of the checkpoint queues. As a result the server memory is overloaded and waiting to persist items to disk. The stat that is used by ns_server for the alerts is also no the correct stat. ep_overhead is use to keep track of the size of the checkpoint queues and other structures used by ep-engine. The correct stat to use (vb_active_meta_data + vb_replica_meta_data + vb_pending_meta_data). This should resolve the issue. Also, note that the issue of heavy checkpointing overhead will benefit greatly from having multiple writers in our next release.
      Hide
      alkondratenko Aleksey Kondratenko (Inactive) added a comment -

      BTW, not having to parse 3 stats and add them together could help us (ns_server team). We have certain inefficiency parsing/handling larger count of stats.

      Show
      alkondratenko Aleksey Kondratenko (Inactive) added a comment - BTW, not having to parse 3 stats and add them together could help us (ns_server team). We have certain inefficiency parsing/handling larger count of stats.
      Hide
      mikew Mike Wiederhold added a comment -

      I will add this and assign the bug back to you once I'm done.

      Show
      mikew Mike Wiederhold added a comment - I will add this and assign the bug back to you once I'm done.
      Show
      mikew Mike Wiederhold added a comment - http://review.couchbase.org/#/c/23618/ http://review.couchbase.org/#/c/23619/
      Hide
      thuan Thuan Nguyen added a comment -

      Integrated in github-ep-engine-2-0 #467 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/467/)
      MB-7354: Provide an aggregated meta data stat (Revision 5fab317edee5ce4af28f8f47ddb352cb3217a15e)

      Result = SUCCESS
      Mike Wiederhold :
      Files :

      • docs/stats.org
      • src/ep_engine.cc
      Show
      thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #467 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/467/ ) MB-7354 : Provide an aggregated meta data stat (Revision 5fab317edee5ce4af28f8f47ddb352cb3217a15e) Result = SUCCESS Mike Wiederhold : Files : docs/stats.org src/ep_engine.cc

        People

        • Assignee:
          mikew Mike Wiederhold
          Reporter:
          perry Perry Krug
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Gerrit Reviews

            There are no open Gerrit changes