UPR Issue: Hard failover of a node with firewall restriction leads to rebalance stuck

3.0.0-680, centos 64 bit, vbuckets=128

Node: 10.6.2.144-150

1. Create a 7 node cluster
2. Add a default bucket with around 10K items with mutations add, delete, update
3. Wait till everything persists
4. Add 5 views with build indexes and run queries
5. Add firewall restriction to one node '10.6.2.146'
6. Hard Failover node with firewall restrictions
7. Rebalance the cluster.

Rebalance:: rebalance params : password=password&ejectedNodes=ns_1%4010.6.2.146&user=Administrator&knownNodes=ns_1%4010.6.2.146%2Cns_1%4010.6.2.144%2Cns_1%4010.6.2.145%2Cns_1%4010.6.2.147%2Cns_1%4010.6.2.148%2Cns_1%4010.6.2.150%2Cns_1%4010.6.2.149

In Step 6, rebalance is stuck with 50% complete

Firewall Restrictions are added as follows:

For the server which will be failver, we make remote connection to it and do the following

1. Reject incoming connections on port 1000->65535
   o, r = shell.execute_command("/sbin/iptables -A INPUT -p tcp -i eth0 --dport 1000:65535 -j REJECT")
   shell.log_command_output(o, r)

1. Reject outgoing connections on port 1000->65535
   if bidirectional:
   o, r = shell.execute_command("/sbin/iptables -A OUTPUT -p tcp -o eth0 --sport 1000:65535 -j REJECT")
   shell.log_command_output(o, r)

TEST CASE:: ./testrunner -i /root/systest-worker/testrunner/palm.ini -t failover.failovertests.FailoverTests.test_failover_firewall,replicas=1,graceful=False,num_failed_nodes=1,items=10000,dgm_run=True,doc_ops=update:create:delete,withQueries=True,numViews=5,runViews=True,upr=True,vbuckets=128,GROUP=P0