Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11752

Rebalance from 3 to 4 nodes [with views] fails due to "{unexpected_exit, ..., {bulk_set_vbucket_state_failed..."

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • 3.0
    • 3.0
    • ns_server, view-engine
    • Security Level: Public
    • Build 3.0.0-969

      Platform = Physical
      OS = CentOS 6.5
      CPU = Intel Xeon E5-2630 (24 vCPU)
      Memory = 64 GB
      Disk = 2 x SSD

    Description

      Rebalance-in, 3 -> 4, 1 bucket x 100M x 2KB, DGM, 1 x 1 views, 10K mixed ops/sec, 400 queries/sec

      It actually reaches ~99% but fails at the end.

      "Rebalance exited with reason {unexpected_exit, {'EXIT',<0.15520.168>, {bulk_set_vbucket_state_failed, [{'ns_1@172.23.100.32', {'EXIT', {{{noproc, {gen_server,call, ['upr_replicator-bucket-1-ns_1@172.23.100.30',

      {setup_replication, [86,87,88,89,90,91,92,93,94,95,96,97, 98,99,100,101,102,103,104,105,106, 107,108,109,110,111,112,113,114,115, 116,117,118,119,120,121,122,123,124, 125,126,127,128,129,130,131,132,133, 134,135,136,137,138,139,140,141,142, 143,144,145,146,147,148,149,150,151, 152,153,154,155,156,157,158,159,160, 161,162,163,164,165,166,167,168,169, 170]}

      , infinity]}}, {gen_server,call, ['replication_manager-bucket-1',

      {change_vbucket_replication,256, 'ns_1@172.23.100.29'}

      , infinity]}}, {gen_server,call, [

      {'janitor_agent-bucket-1', 'ns_1@172.23.100.32'}

      , {if_rebalance,<0.14989.17>, {update_vbucket_state,256,replica, undefined,'ns_1@172.23.100.29'}}, infinity]}}}}]}}} ",

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavelpaulau Pavel Paulau (Inactive)
            pavelpaulau Pavel Paulau (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty