Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11731

Persistence to disk suffers from bucket compaction

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 3.0
    • 3.0
    • couchbase-bucket
    • Security Level: Public
    • Platform = Physical
      OS = CentOS 6.5
      CPU = Intel Xeon E5-2680 v2 (40 vCPU)
      Memory = 256 GB
      Disk = RAID 10 SSD

    Description

      5 -> 5 UniDir, 2 buckets x 500M x 1KB, 10K SETs/sec, LAN

      This is not a new problem, we could observe it for many months.

      From attached charts you can see that drain rate (and disk write queue correspondingly) are antiphased, every 30-40 minutes one of buckets drains faster.

      On average size of disk write queue doesn't differ from 2.5.x but peak values are slightly higher.

      Attachments

        1. compaction_vs_write_queue.png
          107 kB
          Pavel Paulau
        2. disk_write_queue.png
          165 kB
          Pavel Paulau
        3. drain_rate.png
          146 kB
          Pavel Paulau

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-11799 Bucket compaction causes massive slowness of flusher and UPR consumers

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-11769 Major regression in write performance (xdcr, 2 buckets)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-11732 Auto-compaction doesn't honor fragmentation threshold

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pavelpaulau Pavel Paulau (Inactive)
              pavelpaulau Pavel Paulau (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty