Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7739

windows] memcached connection is lost and rebalance failed with reason {{bulk_set_vbucket_state_failed

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 2.0.1
    • Fix Version/s: 2.5.0
    • Component/s: couchbase-bucket, ns_server
    • Security Level: Public
    • Labels:
    • Environment:

      Description

      -t rebalancetests.IncrementalRebalanceOut.test_load,replica=2,do-stop=True
      3 nodes cluster
      rebalance out 1 node

      [2013-02-13 11:35:37,922] - [rest_client:890] ERROR - {u'node': u'ns_1@10.1.3.85', u'code': 4, u'text': u"Control connection to memcached on 'ns_1@10.1.3.85' disconnected: {{badmatch,
      {error,
      closed}},
      [

      {mc_client_binary, cmd_binary_vocal_recv, 5}

      ,

      {mc_client_binary, select_bucket, 2}

      ,

      {ns_memcached,ensure_bucket, 2}

      ,

      {ns_memcached,handle_info,2}

      ,

      {gen_server,handle_msg,5}, {proc_lib,init_p_do_apply,3}]}"


      [2013-02-13 11:35:37,921] - [rest_client:890] ERROR - "Rebalance exited with reason {{bulk_set_vbucket_state_failed,
      [{'ns_1@10.1.3.82',
      {'EXIT',
      {{{{unexpected_reason,
      badmatch,{error,closed,
      [{mc_client_binary, cmd_binary_vocal_recv,5}, {mc_client_binary, change_vbucket_filter,3}, {ebucketmigrator_srv,handle_call,3},{gen_server,handle_msg,5}

      ,

      {proc_lib,init_p_do_apply,3}]}},
      [{misc,executing_on_new_process,1}, {tap_replication_manager, change_vbucket_filter,4}, {tap_replication_manager, '-do_set_incoming_replication_map/3-lc$^5/1-5-', 2},
      {tap_replication_manager, do_set_incoming_replication_map,3},
      {tap_replication_manager,handle_call,3},
      {gen_server,handle_msg,5},
      {proc_lib,init_p_do_apply,3}

      ]},
      {gen_server,call,
      ['tap_replication_manager-bucket-0',

      {change_vbucket_replication,921, 'ns_1@10.1.3.85'}

      ,
      infinity]}},
      {gen_server,call,
      [

      {'janitor_agent-bucket-0', 'ns_1@10.1.3.82'}

      ,
      {if_rebalance,<0.29108.73>,
      {update_vbucket_state,921,replica,
      undefined,'ns_1@10.1.3.85'}},
      infinity]}}}}]},
      [

      {janitor_agent,bulk_set_vbucket_state,4}

      ,

      {ns_vbucket_mover, update_replication_post_move,3}

      ,

      {ns_vbucket_mover,on_move_done,2}

      ,
      {gen_server,handle_msg,5

      {proc_lib,init_p_do_apply,3}

      ]}"

      attaching logs

        Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Show
          iryna iryna added a comment - https://s3.amazonaws.com/bugdb/jira/MB-7739/86338535/10.1.3.82.zip https://s3.amazonaws.com/bugdb/jira/MB-7739/86338535/10.1.3.84.zip https://s3.amazonaws.com/bugdb/jira/MB-7739/86338535/10.1.3.85.zip
          Hide
          chiyoung Chiyoung Seo added a comment -

          Just for the bug distributions in the engine team

          Show
          chiyoung Chiyoung Seo added a comment - Just for the bug distributions in the engine team
          Hide
          wayne Wayne Siu added a comment -

          Updated the fixed version to 2.2.1 for review.

          Show
          wayne Wayne Siu added a comment - Updated the fixed version to 2.2.1 for review.
          Hide
          chiyoung Chiyoung Seo added a comment -

          We were repeatedly running the same test for more than two weeks, but didn't see this issue so far. We're closing this ticket. Please create a new ticket if you see the same issue with 2.5.0 build.

          Show
          chiyoung Chiyoung Seo added a comment - We were repeatedly running the same test for more than two weeks, but didn't see this issue so far. We're closing this ticket. Please create a new ticket if you see the same issue with 2.5.0 build.

            People

            • Assignee:
              abhinav Abhinav Dangeti
              Reporter:
              iryna iryna
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes