Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-32956

KV throughput regression in SSL scenarios

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Cannot Reproduce
    • 6.5.0
    • None
    • couchbase-bucket
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

      Scenarios and results:

      Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS
      http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all

      This is basic pillowfight test with certification enabled ( --certpath root.pem )
      6.5.0-2185 - 314K ops/sec 
      6.5.0-2201 - 292K ops/sec
      Logs: http://perf.jenkins.couchbase.com/job/ares/9352/console

       

      Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL

      http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all

      YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

      6.5.0-2185 - 2158K ops/sec
      6.5.0-2201 - 172K ops/sec

      6.5.0-2185 logs and CPU profiles: [http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2911/
      ]6.5.0-2201 logs and CPU profiles: http://perf.jenkins.couchbase.com/job/hebe/2909/console

       

      Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes

      http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI

      Another YCSB test, workloadE

      6.5.0-2158 - 10K ops/sec
      6.5.0-2214 - 9K ops/sec

       

       

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          oleksandr.gyryk Alex Gyryk (Inactive) created issue -
          oleksandr.gyryk Alex Gyryk (Inactive) made changes -
          Field Original Value New Value
          Description We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 175K ops/sec

          Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*
          **[http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
           [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 175K ops/sec

          Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          wayne Wayne Siu made changes -
          Affects Version/s Mad-Hatter [ 15037 ]
          wayne Wayne Siu made changes -
          Fix Version/s Mad-Hatter [ 15037 ]
          oleksandr.gyryk Alex Gyryk (Inactive) made changes -
          Description We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
           [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 175K ops/sec

          Logs: [http://perf.jenkins.couchbase.com/job/hebe/2909/console]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
           [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 172K ops/sec

          6.5.0-2185 logs and CPU profiles: 
          6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          oleksandr.gyryk Alex Gyryk (Inactive) made changes -
          Description We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
           [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 172K ops/sec

          6.5.0-2185 logs and CPU profiles: 
          6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          We have several  SSL scenarios. All of them indicate throughput regression between 6.5.0-2185 and 6.5.0-2201. I can't identify exact build/change because none of the builds in between work on CentOS.

          Scenarios and results:

          *Max ops/sec, cbc-pillowfight, 2 nodes, 80/20 R/W, 512B JSON items, 1K batch size, TLS*
           [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/max_ops/all]

          This is basic pillowfight test with certification enabled ( --certpath root.pem )
          6.5.0-2185 - 314K ops/sec 
          6.5.0-2201 - 292K ops/sec
          Logs: [http://perf.jenkins.couchbase.com/job/ares/9352/console]

           
          h4. *Avg Throughput (ops/sec), Workload A, 3 nodes, 12 vCPU, SSL*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/kv/ycsb/all]

          YCSB WokloadA test with certification enabled when creating a connection object (Java SDK, builder.sslEnabled(true))

          6.5.0-2185 - 2158K ops/sec
          6.5.0-2201 - 172K ops/sec

          6.5.0-2185 logs and CPU profiles: [http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2911/
          ]6.5.0-2201 logs and CPU profiles: [http://perf.jenkins.couchbase.com/job/hebe/2909/console|http://perf.jenkins.couchbase.com/view/Weekly/job/hebe/2910/]

           
          h4. *Avg Throughput (queries/sec), Workload E, MOI, SSL, 4 nodes*

          [http://showfast.sc.couchbase.com/#/timeline/Linux/n1ql/ycsb/MOI]

          Another YCSB test, workloadE

          6.5.0-2158 - 10K ops/sec
          6.5.0-2214 - 9K ops/sec

           

           

           

           
          oleksandr.gyryk Alex Gyryk (Inactive) made changes -
          Component/s couchbase-bucket [ 10173 ]
          Operating System Centos 64-bit [ 10020 ]
          Assignee Alex Gyryk [ oleksandr.gyryk ] Dave Rigby [ drigby ]
          Labels TLS performance
          drigby Dave Rigby made changes -
          Assignee Dave Rigby [ drigby ] Trond Norbye [ trond ]
          trond Trond Norbye made changes -
          Resolution Cannot Reproduce [ 5 ]
          Status Open [ 1 ] Resolved [ 5 ]
          trond Trond Norbye made changes -
          Actual End 2019-02-19 20:32 (issue has been resolved)
          wayne Wayne Siu made changes -
          Assignee Trond Norbye [ trond ] Alex Gyryk [ oleksandr.gyryk ]
          wayne Wayne Siu made changes -
          Fix Version/s Mad-Hatter [ 15037 ]
          wayne Wayne Siu made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

          People

            oleksandr.gyryk Alex Gyryk (Inactive)
            oleksandr.gyryk Alex Gyryk (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty