Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11729

CPU utilization by memcached suddenly increases (~2-3x) after couple hours, IO operations affected

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 3.0-Beta, 3.0
    • 3.0
    • couchbase-bucket
    • Security Level: Public
    • Build 3.0.0-963

      Platform = Physical
      OS = CentOS 6.5
      CPU = Intel Xeon E5-2680 v2 (40 vCPU)
      Memory = 256 GB
      Disk = RAID 10 SSD

    Description

      2 nodes, 5 buckets, 200K x 1KB docs per bucket (non-DGM), 2K updates/sec per bucket.

      While verifying fix for MB-11661 I have noticed increment in CPU utilization after 2.5h of access phase. At the same time drain rate dropped, see attached chart from details. Report is available here:

      http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=atlas_300-963_dd2_access

      I didn't find anything suspicious in logs.

      Attachments

        1. disk_write_queue.png
          disk_write_queue.png
          87 kB
        2. memcached_cpu.png
          memcached_cpu.png
          73 kB
        3. perf.after.log
          649 kB
        4. perf.before.log
          681 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavelpaulau Pavel Paulau (Inactive)
            pavelpaulau Pavel Paulau (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty