Graceful Failover -> Full Recovery -> Rebalance, Rebalance is stuck at 75%

Steps:

1. Create a 3 node cluster
2. Create 1 bucket, 9+default scope and 10 collections/scope = 100 collections in total
3. Create 1000000 items sequentially per collection
4. Update 1000000 RandonKey keys to create 50 percent fragmentation per collection
5. Create 1000000 random keys per collection
6. Update 1000000 random keys to create 50 percent fragmentation per collection
7. Rebalance in with Loading of docs
8. Rebalance Out with Loading of docs
9. Rebalance In_Out with Loading of docs
10. Swap with Loading of docs
11. Failover a node and RebalanceOut that node with loading in parallel
12. Failover a node and FullRecovery that node.
13. Bucket Shutdown wait failed for which a separate ticket will be created. Wait for enough time and then did rebalance manually after full recovery. Rebalance is stuck at 75% forever.

guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job3.ini -p bucket_storage=magma,bucket_eviction_policy=fullEviction,rerun=False -t volumetests.Magma.volume.ClusterOpsVolume,nodes_init=3,replicas=1,num_failed_nodes=1,new_replica=1,graceful=True,skip_cleanup=True,num_items=1000000,num_buckets=1,bucket_names=GleamBook,doc_size=1024,bucket_type=membase,eviction_policy=fullEviction,compression_mode=off,iterations=2,sdk_timeout=60,log_level=info,infra_log_level=debug,rerun=False,skip_cleanup=True,key_size=20,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,collection_prefix=Volume,num_scopes=9,num_collections=5,pc=25,ops_rate=200000,key_type=RandomKey,ramQuota=102400,mutation_perc=20 -m rest'