Description
so the cluster is in 5x dgm and when i rebalance out it makes progress for some time and then suddenly rebalance stops with no warning and i get back to the "node waiting to be rebalanced out screen"
rebalncing out again then fails with badarg error.
i dont think that alert thing is related.
getting the diag is taking forever.( will send it to you when completed)
machine info : 10.1.6.149:8091
Node 'ns_1@10.1.6.153' is leaving cluster. ns_cluster001 ns_1@10.1.6.153 09:32:17 - Tue Jun 21, 2011
Rebalance exited with reason {badarg,[
,
{lists,foreach,2}]}
ns_orchestrator002 ns_1@10.1.6.149 09:32:17 - Tue Jun 21, 2011
Shutting down bucket "default" on 'ns_1@10.1.6.153' for server shutdown ns_memcached002 ns_1@10.1.6.153 09:32:15 - Tue Jun 21, 2011
IP address seems to have changed. Unable to listen on 'ns_1@10.1.6.151'. menelaus_web_alerts_srv001 ns_1@10.1.6.151 09:31:05 - Tue Jun 21, 2011
IP address seems to have changed. Unable to listen on 'ns_1@10.1.6.152'. menelaus_web_alerts_srv001 ns_1@10.1.6.152 09:30:00 - Tue Jun 21, 2011
Starting rebalance, KeepNodes = ['ns_1@10.1.6.149','ns_1@10.1.6.150',
'ns_1@10.1.6.151','ns_1@10.1.6.152',
'ns_1@10.1.6.154'], EjectNodes = ['ns_1@10.1.6.153']
ns_orchestrator004 ns_1@10.1.6.149 09:28:26 - Tue Jun 21, 2011
IP address seems to have changed. Unable to listen on 'ns_1@10.1.6.150'. menelaus_web_alerts_srv001 ns_1@10.1.6.150 09:24:29 - Tue Jun 21, 2011
IP address seems to have changed. Unable to listen on 'ns_1@10.1.6.149'. menelaus_web_alerts_srv001 ns_1@10.1.6.149 09:19:51 - Tue Jun 21, 2011
IP address seems to have changed. Unable to listen on 'ns_1@10.1.6.150'. menelaus_web_alerts_srv001 ns_1@10.1.6.150 09:18:30 - Tue Jun 21, 2011
Starting rebalance, KeepNodes = ['ns_1@10.1.6.149','ns_1@10.1.6.150',
'ns_1@10.1.6.151','ns_1@10.1.6.152',
'ns_1@10.1.6.154'], EjectNodes = ['ns_1@10.1.6.153']
ns_orchestrator004 ns_1@10.1.6.150