[MB-47446] More memory overhead for non-collection index - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 7.1.0
Component/s: storage-engine
Labels:
- plasma
- request-dev-verify

Triage:
Untriaged
Story Points:
1
Is this a Regression?:
Unknown

Description

In CC, each non-collection index will use 4M of write buffer. This is more than 2M used in MH. For large number of indexes with small boxes, this may be an issue.

Attachments

Issue Links

backports to

MB-46490 [BP MB-47446] More memory overhead for non-collection index

Closed

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

Ascending order - Click to sort in descending order

Akhil Mundroy added a comment - 16/Jul/21 6:08 AM

Change flush buffer size for the recovery log for dedicated indexes to 256K results in reduction of memory overhead from 4G to 2.5G for 500 dedicated indexes.

Experiments: https://docs.google.com/document/d/1C5SAqW2p1jNlHK7lkPpYky9-bt4WiAME96O6wegjpiw/edit?usp=sharing

Akhil Mundroy added a comment - 16/Jul/21 6:08 AM Change flush buffer size for the recovery log for dedicated indexes to 256K results in reduction of memory overhead from 4G to 2.5G for 500 dedicated indexes. Experiments: https://docs.google.com/document/d/1C5SAqW2p1jNlHK7lkPpYky9-bt4WiAME96O6wegjpiw/edit?usp=sharing

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM

Build couchbase-server-7.1.0-1091 contains indexing commit 7a2879a with commit message:
~~MB-47446~~: Change plasma dedicated instance recovery log flush buffer size to 256K

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM Build couchbase-server-7.1.0-1091 contains indexing commit 7a2879a with commit message: MB-47446 : Change plasma dedicated instance recovery log flush buffer size to 256K

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM

Build couchbase-server-7.1.0-1091 contains indexing commit 7839bf2 with commit message:
~~MB-47446~~: Add configs for plasma flush buffer size

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM Build couchbase-server-7.1.0-1091 contains indexing commit 7839bf2 with commit message: MB-47446 : Add configs for plasma flush buffer size

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM

Build couchbase-server-7.1.0-1091 contains plasma commit 985874d with commit message:
~~MB-47446~~: Split flush buffer size config for dedicated and shared log

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM Build couchbase-server-7.1.0-1091 contains plasma commit 985874d with commit message: MB-47446 : Split flush buffer size config for dedicated and shared log

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM

Build couchbase-server-7.1.0-1091 contains plasma commit b78b1e0 with commit message:
~~MB-47446~~: Add separate config for recovery log flush buffer size

Couchbase Build Team added a comment - 23/Jul/21 2:02 PM Build couchbase-server-7.1.0-1091 contains plasma commit b78b1e0 with commit message: MB-47446 : Add separate config for recovery log flush buffer size

Srinath Duvuru added a comment - 24/Feb/22 11:41 AM

Unit tests cover this.

Srinath Duvuru added a comment - 24/Feb/22 11:41 AM Unit tests cover this.