Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6284

Rebalance exited with reason bulk_set_vbucket_state_failed exit timeout

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0-beta
    • Fix Version/s: 2.0-beta
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
    • Environment:
      build 700

      Description

      1 node rebalancing in 2 nodes, 1M items and goes loading, 11 ddocs indexing, queries running
      Rebalance exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@10.3.121.17',
      {'EXIT',
      {timeout,
      {gen_server,call,
      [

      {'janitor_agent-bucket-0', 'ns_1@10.3.121.17'}

      ,
      {if_rebalance,<0.7759.4>,
      {update_vbucket_state,444,replica,
      undefined,'ns_1@10.3.121.20'}},
      60000]}}}}]},
      [

      {janitor_agent,bulk_set_vbucket_state,4}

      ,

      {ns_vbucket_mover, update_replication_post_move,3}

      ,

      {ns_vbucket_mover,handle_info,2}

      ,

      {gen_server,handle_msg,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}

      1. 10.3.121.17-8091-diag.txt.gz
        9.26 MB
        Iryna
      2. 10.3.121.20-8091-diag.txt.gz
        14.90 MB
        Iryna
      3. 10.3.121.22-8091-diag.txt.gz
        14.75 MB
        Iryna
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        andreibaranouski Andrei Baranouski added a comment -

        I can't reproduce it, tried manually with the similar steps above( didn't try xdcr scenarious)

        Show
        andreibaranouski Andrei Baranouski added a comment - I can't reproduce it, tried manually with the similar steps above( didn't try xdcr scenarious)
        Hide
        junyi Junyi Xie (Inactive) added a comment -

        Based on Andrei's test

        Show
        junyi Junyi Xie (Inactive) added a comment - Based on Andrei's test
        Hide
        ketaki Ketaki Gangal added a comment -

        Andrei has tested this on a non-xdcr setup.
        @Andrei: Can you test this on a 3:3 unidireciotnal replication with 1M items? rebalance out nodes at destination?

        Show
        ketaki Ketaki Gangal added a comment - Andrei has tested this on a non-xdcr setup. @Andrei: Can you test this on a 3:3 unidireciotnal replication with 1M items? rebalance out nodes at destination?
        Hide
        andreibaranouski Andrei Baranouski added a comment -

        checked different combination, it was not reproduced with bulk_set_vbucket_state_failed error. I will close the bug, new one was open

        MB-6535
        Rebalance stopped by janitor on destination cluster and then master has changed several times

        Show
        andreibaranouski Andrei Baranouski added a comment - checked different combination, it was not reproduced with bulk_set_vbucket_state_failed error. I will close the bug, new one was open MB-6535 Rebalance stopped by janitor on destination cluster and then master has changed several times
        Hide
        andreibaranouski Andrei Baranouski added a comment -

        is not reproduced anymore

        Show
        andreibaranouski Andrei Baranouski added a comment - is not reproduced anymore

          People

          • Assignee:
            andreibaranouski Andrei Baranouski
            Reporter:
            iryna iryna
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes