Details
-
Bug
-
Resolution: Fixed
-
Critical
-
4.0.0
-
Security Level: Public
-
Triaged
-
Unknown
Description
Because Hash is O(1) and Tree is O(log n), it is to be expected that during heavy traffic, indexer will fall behing KV.
In this situation, it is important the behavior is predictable and does not lead to unbounded queue growth.
This bug is because apparently, it is possible for mutation queues to grow unbounded in current code. This must be fixed before we ship.
Attachments
Issue Links
For Gerrit Dashboard: MB-13590 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
47913,15 | MB-13590 Initial Build TS Generation Changes | unstable | indexing | Status: MERGED | +2 | +1 |
48674,1 | MB-13590 Catchup phase timestamps can be merged | unstable | indexing | Status: ABANDONED | 0 | 0 |
48675,14 | MB-13590 Add limit to mutation queue | unstable | indexing | Status: MERGED | +2 | +1 |
48676,2 | MB-13590 Slice Writer Implementation Changes | unstable | indexing | Status: ABANDONED | 0 | 0 |
48814,2 | MB-13590 Use sync.pool to reuse buffer for collatejson | unstable | indexing | Status: MERGED | +2 | +1 |
48815,2 | MB-13590 Remove json encoding for back index key | unstable | indexing | Status: MERGED | +2 | +1 |
48979,4 | MB-13590 Better default values | unstable | indexing | Status: ABANDONED | 0 | 0 |
48980,14 | MB-13590 Indexer to have its own timer/sync msg mechanism | unstable | indexing | Status: MERGED | +2 | +1 |
49222,11 | MB-13590 Avoid calling len twice in fdb GetKV/SetKV | unstable | indexing | Status: MERGED | +2 | +1 |
49223,11 | MB-13590 Log flusher count stat | unstable | indexing | Status: MERGED | +2 | +1 |
49224,11 | MB-13590 Minor Refactor - Add WaitPersist to slice writer | unstable | indexing | Status: MERGED | +2 | +1 |
49225,11 | MB-13590 Refactor mutation structs to mutation.go | unstable | indexing | Status: MERGED | +2 | +1 |
49227,14 | MB-13590 Indexer: Reduce garbage | unstable | indexing | Status: MERGED | +2 | +1 |
49229,10 | MB-13590 Indexer - Sync pool for Timestamp | unstable | indexing | Status: MERGED | +2 | +1 |
49230,7 | MB-13590 Indexer: Sync pool for mutations | unstable | indexing | Status: ABANDONED | +1 | 0 |
49604,13 | MB-13590 dataport - reuse transport pkt | unstable | indexing | Status: MERGED | +2 | +1 |
50034,12 | MB-13590 Tests for Mutation Queue | unstable | indexing | Status: MERGED | +2 | +1 |
50035,12 | MB-13590 dataport - remove unused code | unstable | indexing | Status: MERGED | +2 | +1 |
50036,12 | MB-13590 Remove unused slab manager | unstable | indexing | Status: MERGED | +2 | +1 |
50249,1 | MB-13590 Initial Build TS Generation Changes | master | indexing | Status: ABANDONED | 0 | 0 |
50250,1 | MB-13590 Add limit to mutation queue | master | indexing | Status: ABANDONED | 0 | 0 |
50251,1 | MB-13590 Indexer to have its own timer/sync msg mechanism | master | indexing | Status: ABANDONED | 0 | 0 |
50253,1 | MB-13590 Avoid calling len twice in fdb GetKV/SetKV | master | indexing | Status: ABANDONED | 0 | 0 |
50254,1 | MB-13590 Log flusher count stat | master | indexing | Status: ABANDONED | 0 | 0 |
50255,1 | MB-13590 Minor Refactor - Add WaitPersist to slice writer | master | indexing | Status: ABANDONED | 0 | 0 |
50256,1 | MB-13590 Refactor mutation structs to mutation.go | master | indexing | Status: ABANDONED | 0 | 0 |
50258,1 | MB-13590 Indexer: Reduce garbage | master | indexing | Status: ABANDONED | 0 | 0 |
50259,1 | MB-13590 Indexer - Sync pool for Timestamp | master | indexing | Status: ABANDONED | 0 | 0 |
50260,1 | MB-13590 Indexer: Sync pool for mutations | master | indexing | Status: ABANDONED | 0 | 0 |
50262,1 | MB-13590 dataport - reuse transport pkt | master | indexing | Status: ABANDONED | 0 | 0 |
50263,1 | MB-13590 Tests for Mutation Queue | master | indexing | Status: ABANDONED | 0 | 0 |
50264,1 | MB-13590 dataport - remove unused code | master | indexing | Status: ABANDONED | 0 | 0 |
50265,1 | MB-13590 Remove unused slab manager | master | indexing | Status: ABANDONED | 0 | 0 |
50423,1 | MB-13590 Send config update to kv_sender/mut_mgr | unstable | indexing | Status: MERGED | +2 | +1 |