Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62432

MinValueBlockSizeThreshold prevents users from setting seq index data block size higher than 64KB

    XMLWordPrintable

Details

    • 0

    Description

      We allow a user to SetSeqTreeDataBlockSize upto 128KB. This means, Magma should accumulate data upto 128KB before forming a block and then apply block compression to it. For example, if we write two documents whose size is 64KB each (post snappy per-document compression), then we should place them together in a single block and then apply block compression to it.

      However, there's another setting that kind of overrides SetSeqTreeDataBlockSize from taking effect. It is the MinValueBlockSizeThreshold, which is internally set to 64KB. The impact is that if a document (post snappy per-doc compression) is larger than this, then it goes into its own block with a single item, with no block compression applied at all. So in case of the previous example, due to MinValueBlockSizeThreshold, the two documents will go into their own separate blocks and the intended effect of SetSeqTreeDataBlockSize won't be applied.

      We should adjust the MinValueBlockSizeThreshold to max(64KB, SetSeqTreeDataBlockSize).

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            rohan.suri Rohan Suri
            rohan.suri Rohan Suri
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty