Details
Description
Steps:-
1) Remove a server, rebalance it out.
2) Trigger view compaction on few ddocs manually
Seems to be in ns_server, as RPC call sync_send_all_state_event seems to be failing for force_compact_view.
Is 10 secs too less for the timeout?
Server error during processing: ["web request failed",
{path,"/pools/default"},
{type,exit},
{what,
{noproc,
}},
{trace,
[
,
{ns_cluster_membership, is_stop_rebalance_safe,0},
{menelaus_web,build_pool_info,4},
{menelaus_web,handle_pool_info_wait,6},
{menelaus_web,check_and_handle_pool_info,2},
{menelaus_web,loop,3},
{mochiweb_http,headers,5},
{proc_lib,init_p_do_apply,3}]}]2012-08-21 23:09:30.885 compaction_daemon:0:critical:message(ns_1@10.3.2.46) - Failed to start index compaction for `saslbucket/_design/d11` on some nodes:
[{'ns_1@10.3.2.47',
{'EXIT',
{noproc,
{gen_fsm,sync_send_all_state_event,
[{compaction_daemon,'ns_1@10.3.2.47'},
{force_compact_view,<<"saslbucket">>,<<"_design/d11">>},
10000]}}}}]
2012-08-21 23:09:31.113 compaction_daemon:0:critical:message(ns_1@10.3.2.46) - Failed to start index compaction for `saslbucket/_design/d10` on some nodes:
[{'ns_1@10.3.2.46',
{'EXIT',
{badmatch,{ok,<0.28902.18>,
[{compaction_daemon,register_forced_compaction,3},
{compaction_daemon,handle_sync_event,4},
{gen_fsm,handle_msg,7},
{proc_lib,init_p_do_apply,3}
]},
{gen_fsm,sync_send_all_state_event,
[
,
10000]}}}},
{'ns_1@10.3.2.47',
{'EXIT',
{badmatch,{ok,<18275.10321.18>,
[{compaction_daemon,register_forced_compaction,3},
{compaction_daemon,handle_sync_event,4},
{gen_fsm,handle_msg,7},
{proc_lib,init_p_do_apply,3}]},
{gen_fsm,sync_send_all_state_event,
[{compaction_daemon,'ns_1@10.3.2.47'},
{force_compact_view,<<"saslbucket">>,<<"_design/d10">>}
,
10000]}}}},
{'ns_1@10.3.2.48',
{'EXIT',
{badmatch,{ok,<18276.4531.17>,
[
,
,
,
]},
{gen_fsm,sync_send_all_state_event,
[
,
,
10000]}}}}
Views
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d1' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,doc.key);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d2' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.key_num]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d3' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.name]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d4' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.email]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d5' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.city]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d6' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.country]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d7' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.realm]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d8' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.coins]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d9' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.category]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d10' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.achievements]);\n}"} }}'
curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d11' \
-d '{"views": { "v1":{"map":"function(doc)
"}, "v2":{"map":"function(doc,meta)
{\nemit(meta.id,[doc.key_num,doc.body]);\n}"} }}'
Attachments
For Gerrit Dashboard: MB-6371 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
20030,3 | MB-6371 Check if forced compaction is already running correctly. | master | ns_server | Status: MERGED | +2 | +1 |
20031,3 | MB-5307 Try to discover master on alive nodes (excluding us). | master | ns_server | Status: MERGED | +2 | +1 |
20076,2 | MB-6380 Add more tests and logging for compaction retries | master | couchdb | Status: MERGED | +2 | +1 |