Details
Description
Running the kubernetes system test. Rebalance fails. Have attached the logs. The setup is 1 K8s cluster of 8 nodes, 2 couchbase clusters in same namespace with 4 nodes each. The tests rebalances out a node, then rebalances in the node, then rebalances the cluster. The final rebalance fails in the test. After the test failed, I tried to go into the cluster and manually rebalance with couchbase-cli. That attempt just hangs forever. Not sure what the expected behaviour is because the cluster seems to already be rebalanced before I try to manually rebalance with cli and thus the UI rebalance button is not clickable.
Logs are here: http://qa.sc.couchbase.com/view/Cloud/job/trigger-kubernetes-system/110/artifact/logs/2018-08-21T18%3A18%3A15-07%3A00/TestFeaturesAll/
The relevant cluster is jsca9, nothing was done to the other cluster, 44ii9