Details
-
Task
-
Resolution: Fixed
-
Critical
-
None
-
1
Description
We want to make sure that bloom filter doesn't consume more memory than specified bloom filter quota. Bloom filter has memory overhead of 0.8 byte per key. With 1% DGM and very small keys like 10 bytes in size, it can potentially exceed bucket quota with large number of keys
Memory usage can be limited by using high watermark. We can evict bloom filters from bottom level to toplevel order based on total bloom filter memory usage.
Attachments
For Gerrit Dashboard: MB-49489 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
171832,2 | Revert "MB-49489 magma: Disable load of BloomFilter during SSTable init" | master | magma | Status: NEW | 0 | +1 |