Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11536

[system test] [kv unix] rebalance hang due to uneven memmory distribution between nodes

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 3.0
    • 3.0
    • couchbase-bucket
    • Security Level: Public
    • None
    • centos 6.4 64-bit

    Description

      Install couchbase server 3.0.0-858 on 8 nodes
      1:172.23.107.195
      2:172.23.107.196
      3:172.23.107.197
      4:172.23.107.199
      5:172.23.107.200
      6:172.23.107.202
      7:172.23.107.201

      8:172.23.107.203

      Create a cluster of 7 nodes
      Create 2 buckets: default and sasl-2 (no view)
      Load 25 M items to each bucket to bring down active resident ratio down to 80%
      Do update, expired and delete on both buckets in 3 hours.
      Then add node 203 to cluster. Passed
      Remove node 200 out cluster. Passed
      Swap master node (remove 195 and add back 200). Passed

      Failover node 201. Rebalance hang.
      Check bucket sasl-2, see mem used > high water mark
      Adjust bucket quota on bucket sasl-2 to make mem used < high water mark.
      Rebalance still hang
      Check memory used. Total mem used of cluster < high water mark, but at each node, some nodes have mem used higher than water mark.

      This bug may relate to bug MB-11488

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              thuan Thuan Nguyen
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty