Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
7.1.0
Description
I re-run two existing XDCR tests with Magma. Compared to Couchstore, Magma performance is about 50% lower. I open this ticket to track XDCR+Magma performance improvement. All runs were running on build 7.1.0-1401.
Avg. initial XDCR rate (items/sec), 1 -> 1 (2 source nozzles, 4 target nozzles), 1 bucket x 100M x 1KB
Storage | XDCR rate | Job |
---|---|---|
Couchstore | 141381 | http://perf.jenkins.couchbase.com/job/titan/12218/ |
Magma | 79794 | http://perf.jenkins.couchbase.com/job/titan/12214/ |
Avg. initial XDCR rate (items/sec), 5 -> 5 (2 source nozzles, 4 target nozzles), 1 bucket x 250M x 1KB
Storage | Heading 2 | Job |
---|---|---|
Couchstore | 619398 | http://perf.jenkins.couchbase.com/job/titan/12217/ |
Magma | 343931 | http://perf.jenkins.couchbase.com/job/titan/12215/ |
Attachments
Issue Links
- is duplicated by
-
MB-48569 [Magma, 30TB, 1% DGM]: Indexer drain rate is extremely slow
-
- Closed
-
Gerrit Reviews
For Gerrit Dashboard: MB-48834 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
168943,2 | MB-48834 util/file: Add support for sync_file_range | master | magma | Status: NEW | 0 | +1 |
I have a prototype exposing magma bloom filter through Magma::KeyMayExist API and use that API to enable KeyMayExist check for magma in the frontend threads. Throughtput improved from 278766/s to 424707/s.
We see p50 GET_META latency drop from 45us to 10us with this change which skips bgFetch code path. This is roughly equivalent to bg_load latency (12us) we observed in the prior run (saving bgFetch cost). We may want to investigate if the 35us for the bg fetch path is reasonable. I don't know if it is related to more frontend threads vs lesser bg fetch threads and hence frontend waiting for bg fetch threads. This needs to be validated.
The following data is collected for "GET_META"¬
[ 0.00 - 3.00]us (0.0000%)▸ 4532| ¬
[ 3.00 - 6.00]us (10.0000%)▸ 33703673| ############################################¬
[ 6.00 - 7.00]us (20.0000%)▸ 22812220| #############################¬
[ 7.00 - 8.00]us (30.0000%)▸ 18972811| ########################¬
[ 8.00 - 9.00]us (40.0000%)▸ 15037567| ###################¬
[ 9.00 - 10.00]us (50.0000%)▸ 12711962| ################¬
[ 10.00 - 11.00]us (55.0000%)▸ 11717598| ###############¬
[ 11.00 - 12.00]us (60.0000%)▸ 11238608| ##############¬
[ 12.00 - 13.00]us (65.0000%)▸ 10593831| #############¬
[ 13.00 - 14.00]us (70.0000%)▸ 9490448| ############¬
[ 14.00 - 15.00]us (75.0000%)▸ 8026767| ##########¬
[ 15.00 - 16.00]us (77.5000%)▸ 6497436| ########¬
[ 16.00 - 16.00]us (80.0000%)▸ 0| ¬
[ 16.00 - 17.00]us (82.5000%)▸ 5172050| ######¬
[ 17.00 - 19.00]us (85.0000%)▸ 7659343| #########¬
[ 19.00 - 20.00]us (87.5000%)▸ 3021360| ###¬
[ 20.00 - 21.00]us (88.7500%)▸ 2690605| ###¬
[ 21.00 - 22.00]us (90.0000%)▸ 2422527| ###¬
[ 22.00 - 23.00]us (91.2500%)▸ 2178659| ##¬
[ 23.00 - 24.00]us (92.5000%)▸ 1916079| ##¬
[ 24.00 - 26.00]us (93.7500%)▸ 2995509| ###¬
[ 26.00 - 27.00]us (94.3750%)▸ 1136144| #¬
[ 27.00 - 28.00]us (95.0000%)▸ 936203| #¬
[ 28.00 - 29.00]us (95.6250%)▸ 772154| #¬
[ 29.00 - 31.00]us (96.2500%)▸ 1178621| #¬
[ 31.00 - 35.00]us (96.8750%)▸ 1460445| #¬
[ 35.00 - 37.00]us (97.1875%)▸ 457187| ¬
[ 37.00 - 41.00]us (97.5000%)▸ 573703| ¬
[ 41.00 - 49.00]us (97.8125%)▸ 475481| ¬
[ 49.00 - 67.00]us (98.1250%)▸ 604837| ¬
[ 67.00 - 79.00]us (98.4375%)▸ 669727| ¬
[ 79.00 - 87.00]us (98.5938%)▸ 495717| ¬
[ 87.00 - 91.00]us (98.7500%)▸ 232754| ¬
http://perf.jenkins.couchbase.com/job/titan-xdcr-dev/92/console