Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43620

Investigate why Snappy upgrade from 1.1.1 to 1.1.6 regressed performance

    XMLWordPrintable

Details

    • Task
    • Resolution: Fixed
    • Major
    • 7.1.0
    • Cheshire-Cat
    • couchbase-bucket
    • None
    • 1
    • KV-Engine Sprint 2021 August, KV-Engine-Sept-21

    Description

      We attempted to upgrade Snappy from 1.1.1 to 1.1.6 via MB-25339, as part of Vulcan. However this "upgraded" version resulted in various performance regressions (MB-26922, MB-26923, MB-26924), even though Snappy's own published numbers and our own micro-benchmarking runs the newer version was faster (up to 20% faster decompress, 5% faster compress; see https://github.com/google/snappy/releases/tag/1.1.4).

      KV-Engine continues to spend a significant amount of time in snappy (de)compression; moreso for high DGM workloads (all data on-disk is Snappy-compressed), so it would be advantageous if we could take advantage of the performance improvements which should be available in newer versions. However we first need to understand why the last upgrade regressed.

      Attachments

        1. non-dgm_dwq.png
          101 kB
          Paolo Cocchi
        2. eb0c736735b22f3500ecf2e95e26a3c3.png
          30 kB
          Dave Rigby
        3. e8f0965cc86a64ef2678316a74b276da.png
          30 kB
          Dave Rigby
        4. d056096c18cf84643dc7317148ce4c77.png
          27 kB
          Dave Rigby
        5. ce5aefdd81548f4859cc948947f0f20f.png
          31 kB
          Dave Rigby
        6. 7d953b61958286f86d6bacb30330e47f.png
          36 kB
          Dave Rigby
        7. 6cabe2a925c986a0e13b514aaad31a5b.png
          38 kB
          Dave Rigby

        Issue Links

          For Gerrit Dashboard: MB-43620
          # Subject Branch Project Status CR V

          Activity

            People

              drigby Dave Rigby (Inactive)
              drigby Dave Rigby (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There is 1 open Gerrit change

                  PagerDuty