Details
-
Improvement
-
Resolution: Unresolved
-
Major
-
None
-
0
-
Magma-Aug24-2024
Description
Currently, Magma does not cache data blocks by default due to the fact the KV has its own document caching. For BHIVE, it does not have its own cache, so we will need to enable data block caching in Magma as a setting, or alternatively BHIVE to build its own vector cache. We also need to be able to calculate RR including data blocks (not just on the index blocks).
We need to introduce a new optional config flag to enable caching data blocks from bySeqIndex. Necessary stats needs to be introduced to report the aggregate resident ratio for index+data blocks.
Attachments
Gerrit Reviews
For Gerrit Dashboard: MB-62053 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
213231,40 | MB-62053 magma: Enable data block caching | master | magma | Status: MERGED | +2 | +1 |
213657,7 | MB-62053 magma: Add config to change BlockCache partition count | master | magma | Status: MERGED | +2 | +1 |
213986,3 | MB-62053 magma: Cache local index when data block caching is enabled | master | magma | Status: MERGED | +2 | +1 |
214437,3 | [BP] MB-62053 magma: Add config to change BlockCache partition count | cypher | magma | Status: MERGED | +2 | +1 |
214438,2 | [BP] MB-62053 magma: Enable data block caching | cypher | magma | Status: MERGED | +2 | +1 |
214439,2 | [BP] MB-62053 magma: Cache local index when data block caching is enabled | cypher | magma | Status: MERGED | +2 | +1 |
214571,2 | MB-62053 magma: expose blockcache config and resident ratio in json | cypher | magma | Status: MERGED | +2 | +1 |