Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10781

error during upr_takeover failing over crashed node

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • 3.0
    • 3.0
    • None
    • Security Level: Public
    • cluster run
    • Untriaged
    • Unknown

    Description

      • Load 400k items in a node1
      • rebalance in node2
      • rebalance in node3 and crash node1
        At this point rebalance is hanging at 0% and I stopped rebalance.
        Attempted to failover node1 and rebalance throws error:

      Rebalance exited with reason {unexpected_exit,
      {'EXIT',<0.2174.0>,
      {{{{{badmatch,
      [{<18639.1786.0>,
      {done,exit,
      {badmatch,{error,closed,
      [{upr_proxy,handle_packet,4,
      [

      {file,"src/upr_proxy.erl"}, {line,117}]},
      {mc_replication,process_data,3,
      [{file,"src/mc_replication.erl"}, {line,62}]},
      {mc_replication,process_data,4,
      [{file,"src/mc_replication.erl"}, {line,79}]},
      {upr_proxy,handle_info,2,
      [{file,"src/upr_proxy.erl"}

      ,

      {line,84}

      ]},
      {gen_server,handle_msg,5,
      [

      {file,"gen_server.erl"}, {line,607}]},
      {proc_lib,init_p_do_apply,3,
      [{file,"proc_lib.erl"}, {line,227}]}]},
      {gen_server,call,
      [<18639.1707.0>, {setup_streams,[4,5,6]},
      infinity]}},
      [{gen_server,call,3,
      [{file,"gen_server.erl"}

      ,

      {line,188}

      ]},
      {upr_replicator,
      'spawn_and_wait/1-fun-0',1,
      [

      {file,"src/upr_replicator.erl"}, {line,173}]}]}}]},
      [{misc,
      sync_shutdown_many_i_am_trapping_exits,1,
      [{file,"src/misc.erl"},{line,1475}]},
      {upr_replicator,spawn_and_wait,1,
      [{file,"src/upr_replicator.erl"}

      ,

      {line,195}

      ]},
      {upr_replicator,handle_call,3,
      [

      {file,"src/upr_replicator.erl"}

      ,

      {line,110}

      ]},
      {gen_server,handle_msg,5,
      [

      {file,"gen_server.erl"}

      ,

      {line,588}

      ]},
      {proc_lib,init_p_do_apply,3,
      [

      {file,"proc_lib.erl"}

      ,

      {line,227}

      ]}]},
      {gen_server,call,
      ['upr_replicator-default-n_1@10.0.0.105',

      {setup_replication,[4,5,6]}

      ,
      infinity]}},
      {gen_server,call,
      ['replication_manager-default',

      {upr_takeover,'n_1@10.0.0.105',6}

      ,
      infinity]}},
      {gen_server,call,
      [

      {'janitor_agent-default','n_2@10.0.0.105'}

      ,
      {if_rebalance,<0.2083.0>,
      {upr_takeover,'n_1@10.0.0.105',6}},
      infinity]}}}}

      Attachments

        1. n_0.tar
          723 kB
        2. n_1.tar
          1.36 MB
        3. n_2.tar
          1014 kB
        4. n_3.tar
          387 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            alkondratenko Aleksey Kondratenko (Inactive)
            tommie Tommie McAfee (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty