Details
-
Bug
-
Resolution: User Error
-
Major
-
6.5.0
-
Untriaged
-
Yes
Description
We are observing a decrease in dcp throughput and aggregate query throughput. It looks like they both are caused by the same commit, hence I am filing them together.
The following tests all have performance issues:
- DCP Throughput. 1 node. 250M x 1KB. Java client. compression enabled
- 68612 to 55816
- Avg. Query Throughput (queries/sec). AG8. Aggregation query. Plasma. not_bounded
- 295 to 133
-----------------------------------------
Test
Avg. Query Throughput (queries/sec). AG8. Aggregation query. Plasma. not_bounded
Index
CREATE INDEX ag8 ON `bucket-1`(customer.county, DATE_PART_STR(sold_date, 'year'), DATE_PART_STR(sold_date, 'month'), customer.gender, customer.marital_status, customer.education_status, customer.purchase_estimate, customer.credit_rating, customer.dep_count, customer.dep_employed_count, customer.dep_college_count);
Query
SELECT customer.gender, customer.marital_status, customer.education_status, customer.purchase_estimate, customer.credit_rating, customer.dep_count, customer.dep_employed_count, customer.dep_college_count, COUNT(1) AS cnt FROM `bucket-1` WHERE customer.county IN $1 AND DATE_PART_STR(sold_date, 'year') = $2 AND DATE_PART_STR(sold_date, 'month') BETWEEN $3 AND $3 + 3 GROUP BY customer.gender, customer.marital_status, customer.education_status, customer.purchase_estimate, customer.credit_rating, customer.dep_count, customer.dep_employed_count, customer.dep_college_count ORDER BY customer.gender, customer.marital_status, customer.education_status, customer.purchase_estimate, customer.credit_rating, customer.dep_count, customer.dep_employed_count, customer.dep_college_count LIMIT 100;
Results
6.5.0-3166: 285.0 q/s - http://perf.jenkins.couchbase.com/job/arke/1212/
6.5.0-3167: 208.0 q/s - http://perf.jenkins.couchbase.com/job/arke/1213
Report
Logs
6.5.0-3166
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.12.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.13.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.14.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.15.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.18.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.19.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1212/172.23.97.20.zip
6.5.0-3167
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.12.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.13.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.14.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.15.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.18.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.19.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-1213/172.23.97.20.zip
Changelog
http://172.23.123.43:8000/getchangelog?product=couchbase-server&fromb=6.5.0-3166&tob=6.5.0-3167
PProf
Comment
There are only couchdb, couchbase-cli, and kv_engine commits from 3166-3167. There are also open bugs for indexer that are affecting query performance as well.
-----------------------------------------
Test
DCP Throughput. 1 node. 250M x 1KB. Java client. compression enabled
Results
6.5.0-3166: 66124 w/s - http://perf.jenkins.couchbase.com/job/ares-dcp/379/
6.5.0-3167: 59007 w/s - http://perf.jenkins.couchbase.com/job/ares-dcp/380/
Report
Logs
6.5.0-3166
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-379/172.23.133.11.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-379/172.23.133.12.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-379/172.23.133.13.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-379/172.23.133.14.zip
6.5.0-3167
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-380/172.23.133.11.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-380/172.23.133.12.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-380/172.23.133.13.zip
https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-ares-dcp-380/172.23.133.14.zip
Changelog
http://172.23.123.43:8000/getchangelog?product=couchbase-server&fromb=6.5.0-3166&tob=6.5.0-3167
Comment
Both of these tests seem to produce performance degradation resulting from the same commit.
