Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-16750

Profile and improve vbucket compaction performance

    XMLWordPrintable

Details

    Description

      This ticket is to track the effort to profile and improve the performance of compaction. Since memcached now logs compactions that take longer than 1s, we have greater visibility into how long compactions are taking. Subsequently we've had different logs from different customers where a 500MB vbucket has taken more than 1 minute to compact. a 10GB vbucket has taken 300s to compact. In both instances the understanding is performance is not bound by the performance of the underlying storage.

      Attachments

        1. 100Mdata-ext4.png
          41 kB
          Daniel Owen
        2. Avalon run with compaction set to 1.png
          773 kB
          Matt Ingenthron
        3. Avalon Test with an earlier build (phase I).png
          621 kB
          Matt Ingenthron
        4. Avalon Test with Beta (phase II).png
          623 kB
          Matt Ingenthron
        5. Avalon Test with GA (phase III).png
          672 kB
          Matt Ingenthron
        6. Compaction impact in MB16750.png
          2.41 MB
          Matt Ingenthron
        7. End of Avalon run with compaction set to 1.png
          2.32 MB
          Matt Ingenthron

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              jliang John Liang
              dhaikney David Haikney (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty