Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4595

rebalancing in a new 1.8 node if there are only 1 checkpoint open results in an imbalanced cluster because ep-engine in the source node does not backfill items from the open checkpoint

    Details

      Description

      Keeping this cluster alive.
      http://ec2-67-202-63-126.compute-1.amazonaws.com:8091/index.html#sec=overview

      Steps
      1) Create 4 node cluster on 172.
      2) Upgrade these 4 nodes cluster to 180.
      3) Rebalance in 2 new 180 nodes to this cluster at the same time. (10.83.47.43 and 10.112.27.9 are the brand new 180 nodes that were added onto the cluster. )
      4) After rebalance. The active/replica item count on newly added node (10.83.47.43 and 10.112.27.9) is 0.
      5) Post rebalance, Was able to load the data into (10.83.47.43 and 10.112.27.9) using python loader.

      Attaching logs from all the nodes.

      1. rebalance.jpg
        128 kB
        Karan Kumar
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ep-engine-2-0 #230 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/230/)
        MB-4595 Schedule backfill for a fresh client with empty data (Revision 303ab54372e422b122116a85f2f084071b1491ff)

        Result = SUCCESS
        Chiyoung Seo :
        Files :

        • checkpoint.cc
        • tapconnection.cc
        • ep_testsuite.cc
        • checkpoint.hh
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #230 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/230/ ) MB-4595 Schedule backfill for a fresh client with empty data (Revision 303ab54372e422b122116a85f2f084071b1491ff) Result = SUCCESS Chiyoung Seo : Files : checkpoint.cc tapconnection.cc ep_testsuite.cc checkpoint.hh
        Show
        chiyoung Chiyoung Seo added a comment - http://review.couchbase.org/#change,14297
        Hide
        chiyoung Chiyoung Seo added a comment -

        As Mike is booked with QA-related tasks, I will work on this issue for 1.8.1 release.

        Show
        chiyoung Chiyoung Seo added a comment - As Mike is booked with QA-related tasks, I will work on this issue for 1.8.1 release.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        then thats a different bug can you please open a new issue and mark it as blocker for 2.0 and 1.8.1 ( since now 1.8 is now based on master branch _

        Show
        farshid Farshid Ghods (Inactive) added a comment - then thats a different bug can you please open a new issue and mark it as blocker for 2.0 and 1.8.1 ( since now 1.8 is now based on master branch _
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        I'm able to reproduce that deterministically on 2.0 with lots of items. With checkpoint ids greater then 0 and 1.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - I'm able to reproduce that deterministically on 2.0 with lots of items. With checkpoint ids greater then 0 and 1.

          People

          • Assignee:
            chiyoung Chiyoung Seo
            Reporter:
            karan Karan Kumar (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes