[System test]: Eventing rebalance hung

[2019-04-08T06:42:46-07:00, sequoiatools/couchbase-cli:9f07cc] failover -c 172.23.104.16:8091 --server-failover 172.23.104.18:8091 -u Administrator -p password --force

[2019-04-08T06:43:07-07:00, sequoiatools/couchbase-cli:7acdc1] failover -c 172.23.104.16:8091 --server-failover 172.23.104.25:8091 -u Administrator -p password --force

[2019-04-08T06:43:17-07:00, sequoiatools/couchbase-cli:525de0] rebalance -c 172.23.104.16:8091 -u Administrator -p password

→  

Error occurred on container - sequoiatools/couchbase-cli:[rebalance -c 172.23.104.16:8091 -u Administrator -p password]

docker logs 525de0

docker start 525de0

NWARNING: Could not import cb_version, setting VERSION to 0.0.0-0000-community

rWARNING: couchbase-cli version 0.0.0-0000-community does not match couchbase server version 6.5.0-2859-enterprise

*Unable to display progress bar on this os

JERROR: Rebalance failed. See logs for detailed reason. You can try again.

[2019-04-08T07:11:03-07:00, sequoiatools/cmd:1571eb] 60

[2019-04-08T07:12:20-07:00, sequoiatools/couchbase-cli:c5ad93] server-add -c 172.23.104.16:8091 --server-add 172.23.104.17:8091 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data

[2019-04-08T07:12:43-07:00, sequoiatools/couchbase-cli:941b84] server-add -c 172.23.104.16:8091 --server-add 172.23.104.18:8091 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data

[2019-04-08T07:13:06-07:00, sequoiatools/couchbase-cli:eb8969] server-add -c 172.23.104.16:8091 --server-add 172.23.104.23:8091 -u Administrator -p password --server-add-username Administrator --server-add-password password --services eventing

[2019-04-08T07:13:18-07:00, sequoiatools/couchbase-cli:b8d7a5] rebalance -c 172.23.104.16:8091 -u Administrator -p password

→  

Error occurred on container - sequoiatools/couchbase-cli:[rebalance -c 172.23.104.16:8091 -u Administrator -p password]

docker logs b8d7a5

docker start b8d7a5

NWARNING: Could not import cb_version, setting VERSION to 0.0.0-0000-community

rWARNING: couchbase-cli version 0.0.0-0000-community does not match couchbase server version 6.5.0-2859-enterprise

*Unable to display progress bar on this os

JERROR: Rebalance failed. See logs for detailed reason. You can try again.

[2019-04-08T07:40:33-07:00, sequoiatools/cmd:dc92a5] 60 

Rebalance exited with reason {service_rebalance_failed,eventing,

{rebalance_failed,

{service_error,

<<"eventing rebalance hasn't made progress for past 600 secs">>}}}. Operation Id = 22cb4e80ab9493d7f66bc16f406036bbns_orchestrator 000ns_1@172.23.104.16 7:40:27 AM   Mon Apr 8, 2019

Rebalance exited with reason {service_rebalance_failed,eventing,

{rebalance_failed,

{service_error,

<<"eventing rebalance hasn't made progress for past 600 secs">>}}}. Operation Id = e756a48ff37bf2d555b37d89a374dbd2ns_orchestrator 000ns_1@172.23.104.16 7:10:56 AM   Mon Apr 8, 2019