Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-32642

High swap rebalance time for kv nodes

    XMLWordPrintable

Details

    Description

      Build 6.0.0-1693

      Observed that one node swap rebalance time is ~50-60% higher than one node rebalance in/out time.

      First one node swap rebalance(3 -> 3) time: 230 min
      Second one node swap rebalance(3 -> 3) time: 295 min
      One node rebalance in(3 -> 4) time: 173 min
      One node rebalance out(4 -> 3) time: 176 min

      Job- http://perf.jenkins.couchbase.com/job/arke-multi-bucket/249
      Logs-
      KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.12.zip
      KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.13.zip
      KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.14.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          mahesh.mandhare Mahesh Mandhare (Inactive) created issue -
          drigby Dave Rigby made changes -
          Field Original Value New Value
          Assignee Dave Rigby [ drigby ] Mahesh Mandhare [ mahesh.mandhare ]
          mahesh.mandhare Mahesh Mandhare (Inactive) made changes -
          Component/s ns_server [ 10019 ]
          Component/s couchbase-bucket [ 10173 ]
          shivani.gupta Shivani Gupta made changes -
          Issue Type Bug [ 1 ] Task [ 3 ]
          shivani.gupta Shivani Gupta made changes -
          Issue Type Task [ 3 ] Improvement [ 4 ]
          shivani.gupta Shivani Gupta made changes -
          Assignee Mahesh Mandhare [ mahesh.mandhare ] Dave Rigby [ drigby ]
          drigby Dave Rigby made changes -
          Assignee Dave Rigby [ drigby ] Ajit Yagaty [ ajit.yagaty ]
          poonam Poonam Dhavale made changes -
          Assignee Ajit Yagaty [ ajit.yagaty ] Poonam Dhavale [ poonam ]
          lynn.straus Lynn Straus made changes -
          Fix Version/s Mad-Hatter [ 15037 ]
          poonam Poonam Dhavale made changes -
          Assignee Poonam Dhavale [ poonam ] Mahesh Mandhare [ mahesh.mandhare ]
          mahesh.mandhare Mahesh Mandhare (Inactive) made changes -
          Description Build 6.0.0-1693

          Observed that one node swap rebalance time is ~50-60% higher than one node rebalance in/out time.

          First one node swap rebalance time: 230 min
          Second one node swap rebalance time: 295 min
          One node rebalance in time: 173 min
          One node rebalance out time: 176 min


          Job- http://perf.jenkins.couchbase.com/job/arke-multi-bucket/249
          Logs-
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.12.zip
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.13.zip
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.14.zip
          Build 6.0.0-1693

          Observed that one node swap rebalance time is ~50-60% higher than one node rebalance in/out time.

          First one node swap rebalance(3 -> 3) time: 230 min
          Second one node swap rebalance(3 -> 3) time: 295 min
          One node rebalance in(3 -> 4) time: 173 min
          One node rebalance out(4 -> 3) time: 176 min


          Job- http://perf.jenkins.couchbase.com/job/arke-multi-bucket/249
          Logs-
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.12.zip
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.13.zip
          KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.14.zip
          mahesh.mandhare Mahesh Mandhare (Inactive) made changes -
          Assignee Mahesh Mandhare [ mahesh.mandhare ] Poonam Dhavale [ poonam ]
          dfinlay Dave Finlay made changes -
          Fix Version/s Cheshire-Cat [ 15915 ]
          Fix Version/s Mad-Hatter [ 15037 ]
          poonam Poonam Dhavale made changes -
          Assignee Poonam Dhavale [ poonam ] Ajit Yagaty [ ajit.yagaty ]
          dfinlay Dave Finlay made changes -
          Fix Version/s CheshireCat.Next [ 16908 ]
          Fix Version/s Cheshire-Cat [ 15915 ]
          meni.hillel Meni Hillel (Inactive) made changes -
          Fix Version/s backlog [ 15925 ]
          Fix Version/s CheshireCat.Next [ 16908 ]

          People

            ajit.yagaty Ajit Yagaty [X] (Inactive)
            mahesh.mandhare Mahesh Mandhare (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty