[MB-32956] KV throughput regression in SSL scenarios - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Cannot Reproduce
Affects Version/s: 6.5.0
Fix Version/s: None
Component/s: couchbase-bucket
Labels:
- TLS
- performance

Triage:
Untriaged
Operating System:
Centos 64-bit
Is this a Regression?:
Unknown

Description

We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

Scenarios and results:

Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS
http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all

This is basic pillowfight test with certification enabled ( --certpath root.pem )
6.5.0-2185 - 314K ops/sec
6.5.0-2201 - 292K ops/sec
Logs: http://perf.jenkins.couchbase.com/job/ares/9352/console

Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL

http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all

YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

6.5.0-2185 - 2158K ops/sec
6.5.0-2201 - 172K ops/sec

6.5.0-2185 logs and CPU profiles: [http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2911/
]6.5.0-2201 logs and CPU profiles: http://perf.jenkins.couchbase.com/job/hebe/2909/console

Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes

http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI

Another YCSB test, workloadE

6.5.0-2158 - 10K ops/sec
6.5.0-2214 - 9K ops/sec

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

Ascending order - Click to sort in descending order

Alex Gyryk (Inactive) created issue - 05/Feb/19 4:06 PM

Alex Gyryk (Inactive) made changes - 05/Feb/19 4:07 PM

Field	Original Value	New Value
Description	We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS. Scenarios and results: Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all] This is basic pillowfight test with certification enabled ( --certpath root.pem ) 6.5.0-2185 - 314K ops/sec 6.5.0-2201 - 292K ops/sec Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console] h4. Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all] YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true)) 6.5.0-2185 - 2158K ops/sec 6.5.0-2201 - 175K ops/sec Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console] h4. Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes **[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI] Another YCSB test, workloadE 6.5.0-2158 - 10K ops/sec 6.5.0-2214 - 9K ops/sec	We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS. Scenarios and results: Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all] This is basic pillowfight test with certification enabled ( --certpath root.pem ) 6.5.0-2185 - 314K ops/sec 6.5.0-2201 - 292K ops/sec Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console] h4. Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all] YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true)) 6.5.0-2185 - 2158K ops/sec 6.5.0-2201 - 175K ops/sec Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console] h4. Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI] Another YCSB test, workloadE 6.5.0-2158 - 10K ops/sec 6.5.0-2214 - 9K ops/sec

Wayne Siu made changes - 05/Feb/19 4:56 PM

Affects Version/s

Mad-Hatter [ 15037 ]

Wayne Siu made changes - 05/Feb/19 4:56 PM

Fix Version/s

Mad-Hatter [ 15037 ]

Alex Gyryk (Inactive) made changes - 05/Feb/19 5:16 PM

Description

We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

Scenarios and results:

*Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

This is basic pillowfight test with certification enabled ( --certpath root.pem )
6.5.0-2185 - 314K ops/sec
6.5.0-2201 - 292K ops/sec
Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

6.5.0-2185 - 2158K ops/sec
6.5.0-2201 - 175K ops/sec

Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console]

h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

Another YCSB test, workloadE

6.5.0-2158 - 10K ops/sec
6.5.0-2214 - 9K ops/sec

We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

Scenarios and results:

*Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

This is basic pillowfight test with certification enabled ( --certpath root.pem )
6.5.0-2185 - 314K ops/sec
6.5.0-2201 - 292K ops/sec
Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

6.5.0-2185 - 2158K ops/sec
6.5.0-2201 - 172K ops/sec

6.5.0-2185 logs and CPU profiles:
6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

Another YCSB test, workloadE

6.5.0-2158 - 10K ops/sec
6.5.0-2214 - 9K ops/sec

Alex Gyryk (Inactive) made changes - 06/Feb/19 8:52 AM

Description

We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

Scenarios and results:

*Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

This is basic pillowfight test with certification enabled ( --certpath root.pem )
6.5.0-2185 - 314K ops/sec
6.5.0-2201 - 292K ops/sec
Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

6.5.0-2185 - 2158K ops/sec
6.5.0-2201 - 172K ops/sec

6.5.0-2185 logs and CPU profiles:
6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

Another YCSB test, workloadE

6.5.0-2158 - 10K ops/sec
6.5.0-2214 - 9K ops/sec

We have several SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

Scenarios and results:

*Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

This is basic pillowfight test with certification enabled ( --certpath root.pem )
6.5.0-2185 - 314K ops/sec
6.5.0-2201 - 292K ops/sec
Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

[http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

6.5.0-2185 - 2158K ops/sec
6.5.0-2201 - 172K ops/sec

6.5.0-2185 logs and CPU profiles: [http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2911/
]6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

Another YCSB test, workloadE

6.5.0-2158 - 10K ops/sec
6.5.0-2214 - 9K ops/sec

Alex Gyryk (Inactive) made changes - 06/Feb/19 8:53 AM

Component/s		couchbase-bucket [ 10173 ]
Operating System		Centos 64-bit [ 10020 ]
Assignee	Alex Gyryk [ oleksandr.gyryk ]	Dave Rigby [ drigby ]
Labels		TLS performance

Dave Rigby made changes - 07/Feb/19 12:15 AM

Assignee

Dave Rigby [ drigby ]

Trond Norbye [ trond ]

Trond Norbye made changes - 19/Feb/19 6:32 PM

Resolution		Cannot Reproduce [ 5 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Trond Norbye made changes - 19/Feb/19 6:32 PM

Actual End

2019-02-19 20:32 (issue has been resolved)

Wayne Siu made changes - 20/Feb/19 7:17 PM

Assignee

Trond Norbye [ trond ]

Alex Gyryk [ oleksandr.gyryk ]

Wayne Siu made changes - 27/Feb/19 9:59 PM

Fix Version/s

Mad-Hatter [ 15037 ]

Wayne Siu made changes - 31/Oct/19 12:55 AM

Status

Resolved [ 5 ]

Closed [ 6 ]

People

Assignee:: Alex Gyryk (Inactive)

Reporter:: Alex Gyryk (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 05/Feb/19 4:06 PM

Updated:: 31/Oct/19 12:55 AM

Resolved:: 19/Feb/19 6:32 PM

Gerrit Reviews

There are no open Gerrit changes

Couchbase Server

KV throughput regression in SSL scenarios

Details

Description

Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL

Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty