Details
Description
Version 3.0.0-730, Centos 64, vbuckets=128
Nodes: 10.6.2.144-150
1. Add 6 nodes to cluster
2. Create default bucket
3. Add 100K Items
4. Rebalance in out nodes with ops in parallel
Fails in Step 4: Rebalance Stuck/hangs in operation
Test Case
python27 ./testrunner -i /tmp/centos-64-2.0-basic-rebalance-tests-P0.ini GROUP=P0,get-cbcollect-info=False,force_kill_memached=True -t rebalance.rebalanceinout.RebalanceInOutTests.incremental_rebalance_in_out_with_mutation_and_expiration,items=500000,value_size=512,max_verify=100000,GROUP=IN_OUT;P0
Logs :: http://qa.hq.northscale.net/view/3.0.0/job/centos_x64--02_04--Rebalance_tests_UPR-P0/150/console
Rebalance operations that caused the issue
2014-05-23 22:50:52 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance params : password=password&ejectedNodes=ns_1%4010.6.2.150&user=Administrator&knownNodes=ns_1%4010.6.2.146%2Cns_1%4010.6.2.144%2Cns_1%4010.6.2.145%2Cns_1%4010.6.2.147%2Cns_1%4010.6.2.148%2Cns_1%4010.6.2.150%2Cns_1%4010.6.2.149
2014-05-23 22:50:52 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance operation started