Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
None
-
7.1.0
-
Enterprise Edition 7.1.0 build 2434
-
Untriaged
-
Centos 64-bit
-
-
1
-
Unknown
-
Tools 2022-March, Tools 2024-Q1
Description
Build: 7.1.0 - 2434
Unable to rebalance out nodes involving backup service
Rebalance exited with reason {service_rebalance_failed,backup,
|
{worker_died,
|
{'EXIT',<0.3048.33>,
|
{rebalance_failed,
|
{service_error,
|
<<"could not confirm self removed: could not remove self: exhausted retry count after 5 attempts: node status is not out">>}}}}}.
|
Rebalance Operation Id = e315afe1695428616eeded3e557e0f17
|
Initially rebalance failed with the reason
Rebalance exited with reason {service_rebalance_failed,backup,
|
{{badmatch, {error, {bad_nodes,backup,get_agent,
|
[{'ns_1@172.23.136.111', {exit,
|
{{timeout, {gen_server,call,
|
[<35063.7400.0>, {call,"ServiceAPI.CancelTask",
|
#Fun<json_rpc_connection.0.86436583>,
|
#{timeout => 60000}}, 60000]}},
|
{gen_server,call,
|
[{'service_agent-backup', 'ns_1@172.23.136.111'},
|
get_agent,infinity]}}}}]}}},
|
[{service_rebalancer,wait_for_agents,1,
|
[{file,"src/service_rebalancer.erl"}, {line,80}]},
|
{service_rebalancer,run_rebalance,1,
|
[{file,"src/service_rebalancer.erl"}, {line,59}]},
|
{proc_lib,init_p,3, {file,"proc_lib.erl"},{line,211}]}]}}.
|
Rebalance Operation Id = cfdfd36843cfb2e7ecd58e0be21366da
|
Following this all rebalances are failing.
Attachments
Issue Links
- is duplicated by
-
MB-53559 [CBBS] Rebalance fails if previous leader was failed over
- Closed