Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6413

7 empty buckets is nearly killing server [was: Couchbase causes unreasonable high CPU utilization without any connected clients]

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0
    • Fix Version/s: 2.0-beta
    • Security Level: Public
    • Labels:
    • Environment:
      Ubuntu 11.10, 12.04 LTS and CentOS 5.3 - Just plain setup and updated.

      For Ubuntu we're used this package:
      couchbase-server-community_x86_64_2.0.0-1554-rel.deb

      Description

      After setup the Couchbase and creating buckets the load increases to 100% (beam.smp and memcahed causing this, see screenshots).

      All the time there are no clientd connected to this instance. All load was caused from config tasks in the web interface.

      I put also a diagnostic report inside the attachment.

      There where no reports in dmesg output or anything else on system level.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Thanks for filing this. I'll take a look

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Thanks for filing this. I'll take a look
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Thank you very much for reporting this.

        I'm able to reproduce this on my box. This seems to be caused by larger than average number of buckets you have.

        For now consider lowering number of buckets to 2-3 as a workaround

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Thank you very much for reporting this. I'm able to reproduce this on my box. This seems to be caused by larger than average number of buckets you have. For now consider lowering number of buckets to 2-3 as a workaround
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        We're indeed consuming more that 20% of CPU gathering couch stats if there's 7 buckets on my quite quick hardware. On slower box that indeed can be quite a bit higher.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - We're indeed consuming more that 20% of CPU gathering couch stats if there's 7 buckets on my quite quick hardware. On slower box that indeed can be quite a bit higher.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        moving this to 2.0 GA

        Show
        farshid Farshid Ghods (Inactive) added a comment - moving this to 2.0 GA
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ns-server-2-0 #459 (See http://qa.hq.northscale.net/job/github-ns-server-2-0/459/)
        MB-6413: re-implemented bucket_databases using efficient API (Revision 8ba83d2df2b35ebd8fbc621dcad193aec2255fe5)

        Result = SUCCESS
        pwansch :
        Files :

        • src/capi_set_view_manager.erl
        • src/ns_storage_conf.erl
        • src/compaction_daemon.erl
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ns-server-2-0 #459 (See http://qa.hq.northscale.net/job/github-ns-server-2-0/459/ ) MB-6413 : re-implemented bucket_databases using efficient API (Revision 8ba83d2df2b35ebd8fbc621dcad193aec2255fe5) Result = SUCCESS pwansch : Files : src/capi_set_view_manager.erl src/ns_storage_conf.erl src/compaction_daemon.erl
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-couchdb-preview #502 (See http://qa.hq.northscale.net/job/github-couchdb-preview/502/)
        MB-6413 More reliable server startup when testing (Revision 9419f75d63ac4df9222df2d55d64991ea5efbb0d)
        MB-6413: Fix race condition in test 12-errors.t (Revision 39ae383c157c8c6e0df11baf8522540655bbb9cc)
        MB-6413: open all databases on startup (Revision 7db41d630c782db9eee6cd9e74b3b45324bcf463)
        MB-6413: re-implemented all_known_databases/0 (Revision c4ba56ae22ec01bdd3453450f56a4a6e4ece6edb)

        Result = SUCCESS
        pwansch :
        Files :

        • src/couchdb/couch_server_sup.erl
        • src/couch_set_view/test/couch_set_view_test_util.erl
        • src/couchdb/couch_server.erl

        pwansch :
        Files :

        • src/couch_set_view/test/12-errors.t

        pwansch :
        Files :

        • src/couchdb/couch_server.erl

        pwansch :
        Files :

        • src/couchdb/couch_server.erl
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-couchdb-preview #502 (See http://qa.hq.northscale.net/job/github-couchdb-preview/502/ ) MB-6413 More reliable server startup when testing (Revision 9419f75d63ac4df9222df2d55d64991ea5efbb0d) MB-6413 : Fix race condition in test 12-errors.t (Revision 39ae383c157c8c6e0df11baf8522540655bbb9cc) MB-6413 : open all databases on startup (Revision 7db41d630c782db9eee6cd9e74b3b45324bcf463) MB-6413 : re-implemented all_known_databases/0 (Revision c4ba56ae22ec01bdd3453450f56a4a6e4ece6edb) Result = SUCCESS pwansch : Files : src/couchdb/couch_server_sup.erl src/couch_set_view/test/couch_set_view_test_util.erl src/couchdb/couch_server.erl pwansch : Files : src/couch_set_view/test/12-errors.t pwansch : Files : src/couchdb/couch_server.erl pwansch : Files : src/couchdb/couch_server.erl
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        We're still far from being good enough on multiple buckets, but worst problem was recently fixed. We were quadratic on total number of vbuckets (from all buckets) on certain periodic operations and that's now fixed and 7 buckets is far from being as bad as it was

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - We're still far from being good enough on multiple buckets, but worst problem was recently fixed. We were quadratic on total number of vbuckets (from all buckets) on certain periodic operations and that's now fixed and 7 buckets is far from being as bad as it was

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            crowdpark Francis Varga
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes