Details
-
Bug
-
Resolution: Fixed
-
Test Blocker
-
5.5.0
-
5.5.0-2368-enterprise
-
Untriaged
-
Windows 64-bit
-
Yes
Description
Script to Repro
./testrunner -i /tmp/4_nodes_windows_16.ini -p get-logs=true,get-cbcollect-info=true -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=1000,doc_ops=create;update;delete
|
Logs
[2018-03-31 12:02:09,778] - [rest_client:1448] INFO - rebalance params : {'password': 'password', 'ejectedNodes': '', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.109.185,ns_1@172.23.109.186,ns_1@172.23.109.187,ns_1@172.23.104.142'}
|
[2018-03-31 12:02:10,090] - [rest_client:1453] INFO - rebalance operation started
|
[2018-03-31 12:02:10,370] - [rest_client:1584] ERROR - {u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.'} - rebalance failed
|
[2018-03-31 12:02:10,561] - [rest_client:3117] INFO - Latest logs from UI on 172.23.109.185:
|
[2018-03-31 12:02:10,562] - [rest_client:3118] ERROR - {u'node': u'ns_1@172.23.109.185', u'code': 0, u'text': u'Rebalance exited with reason {badmatch,\n {leader_activities_error,\n {default,rebalance},\n {domain_conflict,\n {activity_token,\n {\'ns_1@172.23.109.185\',\n <<"beb9cec29459ae122f15017fca8b151f">>},\n <<"4cdffa82c809d69750ef34b2c179d5bf">>,\n default,\n [rebalance],\n []},\n {activity,<0.22698.4>,#Ref<0.0.3.98913>,\n default,\n <<"e4f9a13d88e2b2a5cf412f177f53eff2">>,\n [{service_janitor,index,\n maybe_complete_pending_failover}],\n majority,\n [quiet]}}}}', u'shortText': u'message', u'serverTime': u'2018-03-31T12:02:09.974Z', u'module': u'ns_orchestrator', u'tstamp': 1522522929974, u'type': u'critical'}
|
Logs attached.
Attachments
Issue Links
For Gerrit Dashboard: MB-29029 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
92236,3 | Only run activity if failover pending. | master | ns_server | Status: ABANDONED | +1 | +1 |
92441,2 | MB-29029: Wait for leader_activity cleanup. | master | ns_server | Status: MERGED | +2 | +1 |
92652,2 | MB-29029 Register with adopters before executing async body. | master | ns_server | Status: MERGED | +2 | +1 |
92655,3 | MB-29029 Wait for conflicting activities to terminate. | master | ns_server | Status: MERGED | +2 | +1 |
92656,3 | MB-29029 Remove temporary workaround. | master | ns_server | Status: MERGED | +2 | +1 |