Details
-
Bug
-
Resolution: Unresolved
-
Critical
-
7.2.6
-
Untriaged
-
0
-
Yes
Description
We see several regressions in N1QL tests on 7.2.6-8083.
https://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/aggregation/Indexing
Initial Indexing Time (min), 10 indexes, non-DGM, partitioned, Plasma
| Build | Index time | Job |
|---|---|---|
| 7.2.6-8076 | 17.5 | https://perf.jenkins.couchbase.com/job/arke-dgm/1711/ |
| 7.2.6-8082 | 17.5 | https://perf.jenkins.couchbase.com/job/arke-dgm/1721/ |
| 7.2.6-8083 | 47.4 | https://perf.jenkins.couchbase.com/job/arke-dgm/1717/ |
| 7.2.6-8086 | 46.7 | https://perf.jenkins.couchbase.com/job/arke-dgm/1719/ |
| 7.2.6-19267 | 17.7 | https://perf.jenkins.couchbase.com/job/arke-dgm/1722 Latest 7.2.6 Old golang version of indexer https://review.couchbase.org/c/indexing/+/212962 |
https://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/count/Plasma
Avg. Query Throughput (queries/sec), Q20, Count (1K matches), 100M docs, Plasma, not_bounded
| Build | Throughput | Job |
|---|---|---|
| 7.2.6-8076 | 35,200 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28429/ |
| 7.2.6-8082 | 35,201 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28713/ |
| 7.2.6-8083 | 22,692 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28624/ |
| 7.2.6-8086 | 22,704 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28669/ |
| 7.2.6-19267 | 34,640 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28736 Latest 7.2.6 Old golang version of indexer https://review.couchbase.org/c/indexing/+/212962 |
https://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/pagination/Plasma
Avg. Query Throughput (queries/sec), Q18, Range Scan with Limit and Offset (1K), Plasma, request_plus
| Build | Throughput | Job |
|---|---|---|
| 7.2.6-8076 | 30,586 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28432/ |
| 7.2.6-8083 | 23,977 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28627/ |
| 7.2.6-8086 | 24,123 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28672/ |
| 7.2.6-19267 | 30,397 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28738/ Latest 7.2.6 Old golang version of indexer https://review.couchbase.org/c/indexing/+/212962 |
Avg. Query Throughput (queries/sec), CI18, Range Scan with Limit and Offset (1K), Covering, Plasma, not_bounded
| Build | Throughput | Job |
|---|---|---|
| 7.2.6-8076 | 42,001 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28431/ |
| 7.2.6-8083 | 28,498 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28626/ |
| 7.2.6-19267 | 40,603 | https://perf.jenkins.couchbase.com/job/iris-multi-client/28737/ Latest 7.2.6 Old golang version of indexer https://review.couchbase.org/c/indexing/+/212962 |
https://showfast.sc.couchbase.com/#/timeline/Linux/hidd/gsi/all
Initial index (min), 1 bucket x 1B x 1KB, 10K KV ops/sec, 1 Indexer Node, Compressed, Plasma, 10% Index Resident Ratio
| Build | Index time | Job |
|---|---|---|
| 7.2.6-8082 | 60.2 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6819/ |
| 7.2.6-8086 | 255.5 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6843/ |
90th percentile secondary scan latency (ms), 1 bucket x 1B x 1KB, 10K KV ops/sec, 1 Indexer Node, Compressed, Plasma, 10% Index Resident Ratio, 90/10
| Build | Latency | Job |
|---|---|---|
| 7.2.6-8082 | 1.39 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6834/ |
| 7.2.6-8086 | 4.51 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6844/ |
Secondary Scan Throughput (scanps) 1 bucket x 1B x 1KB, 10K KV ops/sec, 1 Indexer Node, Compressed, Plasma, 10% Index Resident Ratio, 90/10
| Build | Throughput | Job |
|---|---|---|
| 7.2.6-8082 | 83,141.9 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6834/ |
| 7.2.6-8086 | 26,462.4 | https://perf.jenkins.couchbase.com/job/rhea-5node1/6844/ |
https://showfast.sc.couchbase.com/#/timeline/Linux/secondary/incremental/PlasmaDGM
Incremental index (min), 1 bucket x 100M x 1KB, 10000 indexes, 10K KV ops/sec, 20% Resident, Plasma, s=1 c=1000
| Build | Index time | Job |
|---|---|---|
| 7.2.6-8082 | 101.9 | https://perf.jenkins.couchbase.com/job/hemera/12330/ |
| 7.2.6-8086 | 141.1 | https://perf.jenkins.couchbase.com/job/hemera/12424/ |
| 7.2.6-19267 | 101.8 | https://perf.jenkins.couchbase.com/job/hemera/12537/ |
https://showfast.sc.couchbase.com/#/timeline/Linux/secondary/initial/PlasmaDGM
Initial index (min), 1 bucket x 2B, single 2i index, Initial build only, 50% Resident, PLASMA
| Build | Index time | Job |
|---|---|---|
| 7.2.6-8082 | 83.3 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7731/ |
| 7.2.6-8086 | 257 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7738/ |
| 7.2.6-19267 | 96.8 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7772/ |
https://showfast.sc.couchbase.com/#/timeline/Linux/secondary/lat/PlasmaDGM
90th percentile secondary scan latency (ms), 1 bucket x 250M, single 2i index, 50K KV ops/sec, hot workload, 50% Resident, PLASMA
| Build | Latency | Job |
|---|---|---|
| 7.2.6-8082 | 0.8 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7728/ |
| 7.2.6-8086 | 4.14 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7735/ |
| 7.2.6-19267 | 0.85 | https://perf.jenkins.couchbase.com/job/secondary-plasma-dgm/7773/ |
https://showfast.sc.couchbase.com/#/timeline/Linux/secondary/rebalance/PlasmaDGM
Rebalance-in (min) 3->4, 1 bucket x 55M x 1KB, 100 indexes, 10K KV ops/sec, Plasma 20%RR, s=1 c=10
| Build | Rebalance time | Job |
|---|---|---|
| 7.2.6-8082 | 10.7 | https://perf.jenkins.couchbase.com/job/aether/4609/ |
| 7.2.6-8086 | 26.2 | https://perf.jenkins.couchbase.com/job/aether/4614/ |
https://showfast.sc.couchbase.com/#/timeline/Linux/secondary/thr/Plasma
Secondary index scan throughput (scanps), 1 bucket x 1M x 2KB, 100 KV ops/sec, 100 indexes, PLASMA
| Build | Throughput | Job |
|---|---|---|
| 7.2.6-8082 | 160,523.4 | https://perf.jenkins.couchbase.com/job/secondary-plasma/8951/ |
| 7.2.6-8086 | 69,911.1 | https://perf.jenkins.couchbase.com/job/secondary-plasma/8956/ |
| 7.2.6-19267 | 160500.32379829042 | https://perf.jenkins.couchbase.com/job/secondary-plasma/8980/ |
