Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61352

[System Test] Rebalance exited with reason mover crashed unexpected_exit, 'EXIT',<0.32044.169>,\n dcp_wait_for_data_move_failed

    XMLWordPrintable

Details

    Description

      Script to Repro

      ./sequoia -client 172.23.110.181:2375 -provider file:debian_pine.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 1 -repeat 0 -log_level 0 -version 7.2.5-7571 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=1209600 -show_topology=true
      

      Log Snippet from node 172.23.106.109

      Rebalance exited with reason {mover_crashed,\n                              {unexpected_exit,\n                               {'EXIT',<0.32044.169>,\n                                {{dcp_wait_for_data_move_failed,\"ITEM\",670,\n                                  'ns_1@172.23.97.242',\n                                  ['ns_1@172.23.124.27'],\n                                  {error,no_stats_for_this_vbucket}},\n                                 [{ns_single_vbucket_mover,\n                                   '-wait_dcp_data_move/5-fun-0-',5,\n                                   [{file,\"src/ns_single_vbucket_mover.erl\"},\n                                    {line,451}]},\n                                  {proc_lib,init_p,3,\n                                   [{file,\"proc_lib.erl\"},{line,225}]}]}}}}."}}
      

      Rebalance exited with reason {mover_crashed,\n                              {unexpected_exit,\n                               {'EXIT',<0.15567.530>,\n                                {{dcp_wait_for_data_move_failed,\"NEW_ORDER\",\n                                  176,'ns_1@172.23.97.242',\n                                  ['ns_1@172.23.124.27'],\n                                  {error,no_stats_for_this_vbucket}},\n                                 [{ns_single_vbucket_mover,\n                                   '-wait_dcp_data_move/5-fun-0-',5,\n                                   [{file,\"src/ns_single_vbucket_mover.erl\"},\n                                    {line,451}]},\n                                  {proc_lib,init_p,3,\n                                   [{file,\"proc_lib.erl\"},{line,225}]}]}}}}."}}
      

      Rebalance exited with reason {mover_crashed,\n                              {important_nodes_went_down,\n                               {ns_node_disco_events,\n                                ['ns_1@172.23.104.213','ns_1@172.23.104.215',\n                                 'ns_1@172.23.104.227','ns_1@172.23.105.237',\n                                 'ns_1@172.23.105.238','ns_1@172.23.105.63',\n                                 'ns_1@172.23.106.109','ns_1@172.23.106.121',\n                                 'ns_1@172.23.106.124','ns_1@172.23.106.164',\n                                 'ns_1@172.23.120.59','ns_1@172.23.121.72',\n                                 'ns_1@172.23.121.87','ns_1@172.23.121.94',\n                                 'ns_1@172.23.124.27','ns_1@172.23.96.170',\n                                 'ns_1@172.23.96.186','ns_1@172.23.96.251',\n                                 'ns_1@172.23.96.252','ns_1@172.23.96.253',\n                                 'ns_1@172.23.97.226','ns_1@172.23.97.229',\n                                 'ns_1@172.23.97.242','ns_1@172.23.97.243',\n                                 'ns_1@172.23.97.244','ns_1@172.23.97.245'],\n                                ['ns_1@172.23.104.213','ns_1@172.23.104.215',\n                                 'ns_1@172.23.104.227','ns_1@172.23.105.237',\n                                 'ns_1@172.23.105.238','ns_1@172.23.105.63',\n                                 'ns_1@172.23.106.109','ns_1@172.23.106.121',\n                                 'ns_1@172.23.106.124','ns_1@172.23.106.164',\n                                 'ns_1@172.23.120.59','ns_1@172.23.121.72',\n                                 'ns_1@172.23.121.87','ns_1@172.23.121.94',\n                                 'ns_1@172.23.124.27','ns_1@172.23.96.170',\n                                 'ns_1@172.23.96.186','ns_1@172.23.96.251',\n                                 'ns_1@172.23.96.252','ns_1@172.23.96.253',\n                                 'ns_1@172.23.97.226','ns_1@172.23.97.229',\n                                 'ns_1@172.23.97.242','ns_1@172.23.97.243',\n                                 'ns_1@172.23.97.245']}}}."}}
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              vesko.karaganev Vesko Karaganev
              ankush.sharma Ankush Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty