Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-31241

[System Test]: Rebalance failed with mover_crashed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 6.0.0
    • 6.0.0
    • ns_server
    • centos cluster

    Description

      Build: 6.0.0 build 1614 

      Cycle: 2

      While performing failover of KV node rebalance failed with mover_crashed after 9hrs since rebalance start

      [2018-09-10T10:14:34-07:00, sequoiatools/couchbase-cli:e5c2ff] server-add -c 172.23.108.103:8091 --server-add 172.23.108.104:8091 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data
      		 
      [2018-09-10T10:26:38-07:00, sequoiatools/couchbase-cli:62c527] failover -c 172.23.108.103:8091 --server-failover 172.23.97.239:8091 -u Administrator -p password
      		 
      [2018-09-10T11:01:08-07:00, sequoiatools/couchbase-cli:72634a] rebalance -c 172.23.108.103:8091 -u Administrator -p password

      Error log

      [user:error,2018-09-11T20:27:39.219-07:00,ns_1@172.23.108.103:<0.8021.0>:ns_orchestrator:do_log_rebalance_completion:1117]Rebalance exited with reason {mover_crashed,
      		 
      {unexpected_exit,
      		 
      {'EXIT',<0.684.1355>,
      		 
      {badarg,
      		 
      {gen_server,call,
      		 
      [{'janitor_agent-DISTRICT',
      		 
      'ns_1@172.23.108.104'},
      		 
      {if_rebalance,<0.17033.1318>,
      		 
      {dcp_takeover,'ns_1@172.23.99.21',679}},
      		 
      infinity]}}}}}

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-30967 [System test] : Rebalance failed with noproc and mover_crashed

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-31279 [System test] : Rebalance failed with badarg error

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ajit.yagaty Ajit Yagaty [X] (Inactive)
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty