Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48019

data loading is taking more time in aws runs with 7.0.1/2 builds

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown
    • KV-Engine Sprint 2021 August

    Description

      In our aws perf runs, we noticed it took more time to load data with 7.0.1/2 builds. Compared to 7.0.0 build, it takes almost 30 more minutes to load 500K docs. 

       

      build: 7.0.0-5302

      job: http://perf.jenkins.couchbase.com/job/Cloud-Tester/315/

      logs:

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-315/ec2-3-83-79-7.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-315/ec2-44-195-41-77.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-315/ec2-54-236-37-42.compute-1.amazonaws.com.zip

       

      2021-08-17T19:28:46 [INFO] Running load phase: {

      2021-08-17T19:43:45 [INFO] All tasks are done

      ...

      2021-08-17T19:43:48 [INFO] Monitoring DCP queues: bucket-1

      2021-08-17T19:43:48 [INFO] ep_dcp_replica_items_remaining reached 0

      2021-08-17T19:43:49 [INFO] ep_dcp_other_items_remaining reached 0

      2021-08-17T19:43:49 [INFO] Monitoring replica count match: bucket-1

      2021-08-17T19:43:50 [INFO] curr_items: 499803, replica_curr_items: 499792

      2021-08-17T19:43:52 [INFO] curr_items: 500000, replica_curr_items: 500000

       

      build: 7.0.2-6511

      job: http://perf.jenkins.couchbase.com/job/Cloud-Tester/314/

      logs:

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-314/ec2-18-204-43-57.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-314/ec2-3-235-156-247.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Tester-314/ec2-3-239-225-176.compute-1.amazonaws.com.zip

       

      2021-08-17T17:46:41 [INFO] Running load phase: {

      2021-08-17T18:28:44 [INFO] All tasks are done

      ...

      2021-08-17T18:28:55 [INFO] Monitoring DCP queues: bucket-1

      2021-08-17T18:28:55 [INFO] ep_dcp_replica_items_remaining reached 0

      2021-08-17T18:28:58 [INFO] ep_dcp_other_items_remaining reached 0

      2021-08-17T18:28:58 [INFO] Monitoring replica count match: bucket-1

      2021-08-17T18:29:00 [INFO] curr_items: 500000, replica_curr_items: 500000

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              bo-chun.wang Bo-Chun Wang
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty