Details
Description
Build Tested: 3.0.0-402-rel
1. Load items into the cluster
2. Add node and rebalances that node into the cluster
3. During rebalance perform design docs/views ops(create/update/delete)in the cluster
Expected Output : Rebalance should be successful
Actual Output : Rebalance exited with error
Test to reproduce:
/testrunner -i /tmp/new-viewtests-all.ini get-cbcollect-info=True,get-delays=True -t view.createdeleteview.CreateDeleteViewTests.rebalance_in_and_out_with_ddoc_ops,ddoc_ops=create,test_with_view=True,num_ddocs=3,num_views_per_ddoc=2,items=200000
Tests Failed:
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=create,test_with_view=True,num_ddocs=3,num_views_per_ddoc=2,items=200000
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=update,test_with_view=True,num_ddocs=2,num_views_per_ddoc=3,items=200000
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=delete,test_with_view=True,num_ddocs=2,num_views_per_ddoc=3,items=200000
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=create,test_with_view=False,num_ddocs=3,num_views_per_ddoc=2,items=200000
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=update,test_with_view=False,num_ddocs=2,num_views_per_ddoc=3,items=200000
rebalance_in_and_out_with_ddoc_ops,ddoc_ops=delete,test_with_view=False,num_ddocs=2,num_views_per_ddoc=3,items=200000
Logs:
[rebalance:debug,2014-03-03T10:00:06.647,ns_1@10.1.3.74:<0.12244.1>:janitor_agent:bulk_set_vbucket_state:363]bulk vbucket state change failed for:
[{'ns_1@10.1.3.74',
{'EXIT',
{{{normal,
{gen_server,call,
[<0.14854.1>,
120000]}},
{gen_server,call,
['replication_manager-default',
{change_vbucket_replication,1004,'ns_1@10.1.3.80'},
infinity]}},
{gen_server,call,
[{'janitor_agent-default','ns_1@10.1.3.74'},
{if_rebalance,<0.12244.1>,
{update_vbucket_state,1004,replica,undefined,
'ns_1@10.1.3.80'}},
infinity]}}}}]
[error_logger:error,2014-03-03T10:00:06.648,ns_1@10.1.3.74:error_logger<0.6.0>:ale_error_logger_handler:log_report:115]
=========================CRASH REPORT=========================
crasher:
initial call: tap_replication_manager:init/1
pid: <0.970.0>
registered_name: 'tap_replication_manager-default'
exception exit: {normal,
{gen_server,call,
[<0.14854.1>,
{start_vbucket_filter_change,[1001,1003,1004]}
,
120000]}}
in function gen_server:terminate/6
ancestors: ['replication_manager-default','single_bucket_sup-default',
<0.952.0>]
messages: []
links: [<0.969.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 196418
stack_size: 24
reductions: 5059691
neighbours:
neighbour: [
,
,
{initial_call,{replication_manager,init,['Argument__1']}},
{current_function,{gen,do_call,4}},
,
,
,
,
,
,
,
,
]
[ns_server:error,2014-03-03T10:00:06.649,ns_1@10.1.3.74:<0.14841.1>:ns_single_vbucket_mover:spawn_and_wait:100]Got unexpected exit signal {'EXIT',<0.12244.1>,
{{bulk_set_vbucket_state_failed,
[{'ns_1@10.1.3.74',
{'EXIT',
{{{normal,
{gen_server,call,
[<0.14854.1>,
,
120000]}},
{gen_server,call,
['replication_manager-default',
,
infinity]}},
{gen_server,call,
[
,
{if_rebalance,<0.12244.1>,
{update_vbucket_state,1004,replica,
undefined,'ns_1@10.1.3.80'}},
infinity]}}}}]},
[
,
,
,
,
]}}
Jenkins Job:
http://qa.hq.northscale.net/view/3.0.0/job/centos_x64--29_01--new_view_all-P1/31/consoleFull
Notes:
Uploading Logs