[System Test]: Failover and full recovery of KV made eventing rebalance hung

[2021-01-29T06:34:32-08:00, sequoiatools/couchbase-cli:7.0:00696e] failover -c 172.23.97.215:8091 --server-failover 172.23.107.3:8091 -u Administrator -p password --force --hard

[pull] sequoiatools/couchbase-cli:7.0

[2021-01-29T06:34:40-08:00, sequoiatools/couchbase-cli:7.0:74ad9e] recovery -c 172.23.97.215:8091 --server-recovery 172.23.107.3:8091 --recovery-type full -u Administrator -p password

[pull] sequoiatools/couchbase-cli:7.0

[2021-01-29T06:34:47-08:00, sequoiatools/couchbase-cli:7.0:1b7651] rebalance -c 172.23.97.215:8091 -u Administrator -p password

→ 

Error occurred on container - sequoiatools/couchbase-cli:7.0:[rebalance -c 172.23.97.215:8091 -u Administrator -p password]

docker logs 1b7651

docker start 1b7651

*Unable to display progress bar on this os

[ns_server:error,2021-01-29T06:51:49.128-08:00,ns_1@172.23.97.215:service_rebalancer-eventing<0.31032.63>:service_rebalancer:run_rebalance_worker:125]Worker terminated abnormally: {'EXIT',<0.31103.63>,

                               {rebalance_failed,

                                {service_error,

                                 <<"eventing rebalance hasn't made progress for past 600 secs">>}}}

[user:error,2021-01-29T06:51:49.130-08:00,ns_1@172.23.97.215:<0.9635.0>:ns_orchestrator:log_rebalance_completion:1402]Rebalance exited with reason {service_rebalance_failed,eventing,

                              {worker_died,

                               {'EXIT',<0.31103.63>,

                                {rebalance_failed,

                                 {service_error,

                                  <<"eventing rebalance hasn't made progress for past 600 secs">>}}}}}.

Rebalance Operation Id = 6ffc01be26986551e076b20986e3b232