Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.1.4, 7.1.2, 7.2.0, 7.1.3
-
Triaged
-
0
-
Unknown
Description
Issue introduced by MB-52134 in 7.1.2 (support for ById Scan added to MagmaKVStore).
For OSO backfill (ByKey Scan in KVStore) we miss to set the resume point to the proper key when the backfill is paused. The consequence is that at resume the backfill might resend the last processed key over the stream. By that:
- DCP clients might see key duplicates in OSO snapshots
- Slow DCP clients that force the stream to continuous pausing might stall/loop over receiving the same key multiple times in OSO snapshots
| Issue | Resolution |
| DCP clients streamed in out-of-sequence-order [OSO] backfill snapshots under Magma observed duplicate documents received in the disk snapshot. This happened where the stream was paused and resumed when the resume point was wrongly set to a key already processed in the stream. | OSO backfill in Magma now sets the correct resume point after a pause. |
Attachments
| For Gerrit Dashboard: MB-57106 | ||||||
|---|---|---|---|---|---|---|
| # | Subject | Branch | Project | Status | CR | V |
| 191570,9 | MB-57106: OSO/magma backfill resumes from next item after pause | 7.1.x | kv_engine | Status: MERGED | +2 | +1 |
| 191728,1 | MB-57106: Add comment on MagmaScanResult::Status::Success | 7.1.x | kv_engine | Status: ABANDONED | 0 | +1 |
| 191733,3 | MB-57106: Merge commit 7.1.x/5e46b22da into neo | neo | kv_engine | Status: MERGED | +2 | +1 |
| 191736,5 | MB-57106: Replace MagmaScanResult::Status::Next with existing Success | neo | kv_engine | Status: MERGED | +2 | +1 |
| 192441,4 | MB-57106: Remove MagmaScanResult | neo | kv_engine | Status: MERGED | +2 | +1 |
| 196091,4 | Merge commit neo/ffaa3dd88 into master | master | kv_engine | Status: MERGED | +2 | +1 |
| 196441,1 | Merge commit '0d62c050b' into 'couchbase/master' | master | kv_engine | Status: ABANDONED | 0 | +1 |
| 196453,1 | Merge commit '374483c83' into 'couchbase/master' | master | kv_engine | Status: MERGED | +2 | +1 |