Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-889

Rebalance exited with reason {mover_crashed, {unexpected_exit, {'EXIT',<0.19885.4>,

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • None
    • None
    • openshift
    • CB operator 1.1 running on Openshift 4.0 in AWS

    Description

      Setup CB operator 1.1 running on Openshift 4.0 in AWS

      Configuration is attached as screenshot

      9 Data nodes

      3 Analytics node + (Index+Query) Nodes

      3 Index + Query Nodes

       

      Delete a data pod, rebalance failed with error

       

      Rebalance exited with reason {mover_crashed, {unexpected_exit, {'EXIT',<0.19885.4>, {bulk_set_vbucket_state_failed, [{'ns_1@cb-k8s-tls-demo-0015.cb-k8s-tls-demo.default.svc', {'EXIT', {{{{{case_clause, {error, {{{badmatch, {error, {{badmatch,{error,nxdomain}}, [{dcp_proxy,connect,5, [{file,"src/dcp_proxy.erl"}, {line,228}]}, {dcp_proxy,maybe_connect,2, [{file,"src/dcp_proxy.erl"}, {line,210}]}, {dcp_consumer_conn,init,2, [{file, "src/dcp_consumer_conn.erl"}, {line,57}]}, {dcp_proxy,init,1, [{file,"src/dcp_proxy.erl"}, {line,57}]}, {gen_server,init_it,6, [{file,"gen_server.erl"}, {line,304}]}, {proc_lib,init_p_do_apply,3, [{file,"proc_lib.erl"}, {line,239}]}]}}}, [{dcp_replicator,init,1, [{file,"src/dcp_replicator.erl"}, {line,48}]}, {gen_server,init_it,6, [{file,"gen_server.erl"}, {line,304}]}, {proc_lib,init_p_do_apply,3, [{file,"proc_lib.erl"}, {line,239}]}]}, {child,undefined, {'ns_1@cb-k8s-tls-demo-0003.cb-k8s-tls-demo.default.svc', [del_times,snappy,xattr]}, {dcp_replicator,start_link, ['ns_1@cb-k8s-tls-demo-0003.cb-k8s-tls-demo.default.svc', "tweets", [del_times,snappy,xattr]]}, temporary,60000,worker, [dcp_replicator]}}}}, [{dcp_sup,start_replicator,2, [{file,"src/dcp_sup.erl"}, {line,57}]}, {dcp_sup, '-manage_replicators/2-lc$^3/1-3-', 2, [{file,"src/dcp_sup.erl"}, {line,94}]}, {dcp_replication_manager, handle_call,3, [{file, "src/dcp_replication_manager.erl"}, {line,89}]}, {gen_server,handle_msg,5, [{file,"gen_server.erl"}, {line,585}]}, {proc_lib,init_p_do_apply,3, [{file,"proc_lib.erl"}, {line,239}]}]}, {gen_server,call, ['dcp_replication_manager-tweets', {manage_replicators, ['ns_1@cb-k8s-tls-demo-0003.cb-k8s-tls-demo.default.svc', 'ns_1@cb-k8s-tls-demo-0004.cb-k8s-tls-demo.default.svc', 'ns_1@cb-k8s-tls-demo-0006.cb-k8s-tls-demo.default.svc', 'ns_1@cb-k8s-tls-demo-0008.cb-k8s-tls-demo.default.svc']}, infinity]}}, {gen_server,call, ['replication_manager-tweets', {change_vbucket_replication,454, 'ns_1@cb-k8s-tls-demo-0003.cb-k8s-tls-demo.default.svc'}, infinity]}}, {gen_server,call, [{'janitor_agent-tweets', 'ns_1@cb-k8s-tls-demo-0015.cb-k8s-tls-demo.default.svc'}, {if_rebalance,<0.19800.4>, {update_vbucket_state,454,replica, undefined, 'ns_1@cb-k8s-tls-demo-0003.cb-k8s-tls-demo.default.svc'}}, infinity]}}}}]}}}} hide

       

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ram.dhakne Ram Dhakne (Inactive)
            ram.dhakne Ram Dhakne (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty