Details
-
Bug
-
Resolution: Duplicate
-
Major
-
6.5.0
-
6.5.0-1969-enterprise
-
Untriaged
-
Centos 64-bit
-
Unknown
Description
Script to Repro
./testrunner -i /tmp/testexec.9191.ini -p get-cbcollect-info=True -t rebalance.rebalance_high_ops_pillowfight.RebalanceHighOpsWithPillowFight.test_rebalance_out,nodes_out=1,replicas=1,nodes_init=3,items=2000000,batch_size=1000,rate_limit=100000,instances=2,threads=5,loader=high_ops
|
Basically we do a rebalance out a single node(from a 3 node cluster with 1 replica) with high ops data load running in parallel. Rebalance exits with the following error.
{
|
mover_crashed,
|
\n {
|
unexpected_exit,
|
\n {\
|
'EXIT\',<0.25616.12>,\n{{dcp_wait_for_data_move_failed,"default",\n 506,\'ns_1@172.23.104.251\',\n[\'ns_1@172.23.104.250\',\n \'ns_1@172.23.104.249\'],\n{error,no_stats_for_this_vbucket}},\n[{ns_single_vbucket_mover,\n \'-wait_dcp_data_move/5-fun-0-\',5,\n [{file,"src/ns_single_vbucket_mover.erl"},\n {line,444}]},\n{proc_lib,init_p,3,\n [{file,"proc_lib.erl"},{line,232}]}]}}}}',
|
u 'shortText': u 'message',
|
u 'serverTime': u '2019-01-05T13:45:11.045Z',
|
u 'module': u 'ns_orchestrator',
|
u 'tstamp': 1546724711045,
|
u 'type': u 'critical'
|
}
|
cbcollect_info attached. There are 4 more tests that failed with same error.