Details
-
Bug
-
Resolution: Fixed
-
Test Blocker
-
3.0
-
Security Level: Public
-
None
-
Triaged
-
Unknown
Description
The view engine currently buffers mutations in order to do de-duplication in case there are several snapshots. It currently works, but for 3.0 this needs to fixed properly.
The current idea is to make a distinction between the initial and the incremental index build. In the initial index build only the first (on-disk) snapshot is requested for all partitions that are part of the index. Once it's built the updater is restarted to add all additional items as incremental updates. Whenever a snapshot marker is hit, it will force a flush. Probably the view engine checkpointing code can be re-used to force such a flush.
Attachments
Issue Links
- blocks
-
MB-10803 Initial indexing is 2-3x slower with UPR
- Closed
-
MB-10908 beam.smp RSS grows to 50GB during delta recovery causing OOM killer invocation and rebalance failure
- Closed
- duplicates
-
MB-10803 Initial indexing is 2-3x slower with UPR
- Closed
- is triggered by
-
MB-9974 Rebalance breaks UPR Stream Request
- Resolved
- relates to
-
MB-10640 Upr protocol change to improve rollbacks during a failover case
- Closed
For Gerrit Dashboard: MB-10472 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
34556,1 | Merge remote-tracking branch 'couchbase/upr' into master | master | couchdb | Status: MERGED | +2 | +1 |
35904,7 | MB-10472: Add support for requesting persisted items only | master | couchdb | Status: MERGED | +2 | +1 |
35905,7 | MB-10472: Use the sequence number from doc loader | master | couchdb | Status: MERGED | +2 | +1 |
35906,7 | MB-10472: Build initial index with persisted items only | master | couchdb | Status: MERGED | +2 | +1 |
35907,7 | MB-10472: Change default fake UPR server behavior | master | couchdb | Status: MERGED | +2 | +1 |
37177,2 | MB-10472: Handle incremental updates properly | master | couchdb | Status: MERGED | +2 | +1 |
37178,2 | MB-10472: Simplify ChangesWrapper function | master | couchdb | Status: MERGED | +2 | +1 |
37179,2 | MB-10472: Don't buffer items in memory | master | couchdb | Status: MERGED | +2 | +1 |