Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-28409 Average throughput in YCSB workload A dropped in Vulcan by more than 10%
  3. MB-28772

Compression: SDKs should only send compressed values when efficient to

    XMLWordPrintable

Details

    • Technical task
    • Resolution: Fixed
    • Major
    • 5.5.0
    • 5.5.0
    • clients

    Description

      Based on the commentary on parent MB, it is not efficient to send compressed values unless the bandwidth / memory saving exceeds the cost of working with the compressed value.

      As an extreme example, if a document compressed to exactly the same size as the input, it makes no sense to send compressed. However, the same is also true if the size savings are "too small" - clearly only saving 1B wouldn't be worth sending the document compressed either.

      For a perfect algorithm, you would need to consider the benefits to compression (reduced network bandwidth / latency, reduced server memory requirements), vs the costs (time to compress, time to decompress).

      However its likely we'd choose a simpler set of parameters - for example:

      • Minimum document size (unlikely to recoup compression/decompression costs for documents below a given size).
      • Minimum compression ratio (if we have reduced the size by less than X% then unlikely to gain enough from compression).

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            drigby Dave Rigby (Inactive)
            drigby Dave Rigby (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty