Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-3401

Rebalance failed when one node is out of disk space.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.6.5.3
    • Fix Version/s: 1.7.1
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None

      Description

      Created a 3 node cluster with a bucket of 100G RAM.
      Loaded 15M items, 45G data
      One node (10.2.1.11) is at 100% disk usage.
      Trying to remove that node and adding another node.
      Rebalancing keep failing.
      Trying to remove only that full node, rebalancing keeps failing.

      Rebalance exited with reason {{badmatch,not_present},
      [

      {ns_bucket,credentials,1}

      ,

      {ns_vbm_sup,args,5}

      ,

      {ns_vbm_sup,spawn_mover,4}

      ,

      {ns_vbucket_mover,run_mover,5}

      ,

      {ns_vbucket_mover,'-spawn_workers/1-fun-0-', 5}

      ]}

      See attached logs for more details:

        Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          farshid Farshid Ghods (Inactive) added a comment -

          failover should work in this case but rebalance fails

          Show
          farshid Farshid Ghods (Inactive) added a comment - failover should work in this case but rebalance fails
          Hide
          farshid Farshid Ghods (Inactive) added a comment -

          lets try to reproduce this scenario

          Show
          farshid Farshid Ghods (Inactive) added a comment - lets try to reproduce this scenario
          Hide
          farshid Farshid Ghods (Inactive) added a comment -

          duplicate of MB-3158

          I have added the expected behavior when one or multiple nodes in the cluster are out of disk space

          Show
          farshid Farshid Ghods (Inactive) added a comment - duplicate of MB-3158 I have added the expected behavior when one or multiple nodes in the cluster are out of disk space
          Hide
          farshid Farshid Ghods (Inactive) added a comment -

          duplicate of MB-3158

          Show
          farshid Farshid Ghods (Inactive) added a comment - duplicate of MB-3158
          Hide
          maria Maria McDuff (Inactive) added a comment -

          Dupe.

          Show
          maria Maria McDuff (Inactive) added a comment - Dupe.

            People

            • Assignee:
              thuan Thuan Nguyen
              Reporter:
              sharon Sharon Barr (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes