Details
Description
We are seeing this failure after following ns_server fix was merged http://review.couchbase.org/16399
ERROR REPORT <0.6606.0> 2012-05-29 18:38:13
===============================================================================
ns_1@10.3.121.98:<0.6606.0>:ns_orchestrator:112: Couldn't talk to orchestrator: {exit,
{noproc,
{gen_fsm,
sync_send_event,
[
,
rebalance_progress,
2000]}}}
INFO REPORT <0.64.0> 2012-05-29 18:39:29
===============================================================================
ns_1@10.3.121.98:<0.64.0>:ns_cluster:92: add_node("10.3.121.92", 8091, ..) -> {error,
complete_join,
<<"Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details.">>,
{error,
rest_error,
<<"Failed to start ns_server cluster processes back. Logs might have more details.">>,
}}
INFO REPORT <0.7090.0> 2012-05-29 18:39:29
===============================================================================
ns_log: logging ns_cluster:5:Failed to add node 10.3.121.92:8091 to cluster. Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details.
[2012-05-29 12:33:29,533] - [remote_util:1053] INFO - running command.raw dpkg -i /tmp/couchbase-server-enterprise_x86_64_1.8.1-846-rel.deb
[2012-05-29 12:33:38,205] - [remote_util:1082] INFO - command executed successfully
[2012-05-29 12:33:38,206] - [remote_util:1034] INFO - Selecting previously deselected package couchbase-server.
[2012-05-29 12:33:38,207] - [remote_util:1034] INFO - (Reading database ... 97095 files and directories currently installed.)
[2012-05-29 12:33:38,207] - [remote_util:1034] INFO - Unpacking couchbase-server (from .../couchbase-server-enterprise_x86_64_1.8.1-846-rel.deb) ...
[2012-05-29 12:33:38,207] - [remote_util:1034] INFO - Setting up couchbase-server (1.8.1) ...
[2012-05-29 12:33:38,208] - [remote_util:1034] INFO - * Started couchbase-server
[2012-05-29 12:33:38,208] - [remote_util:1034] INFO -
[2012-05-29 12:33:38,209] - [remote_util:1034] INFO - You have successfully installed Couchbase Server.
[2012-05-29 12:33:38,210] - [remote_util:1034] INFO - Please browse to http://ubuntu1104-64:8091/ to configure your server.
[2012-05-29 12:33:38,210] - [remote_util:1034] INFO - Please refer to http://couchbase.com for additional resources.
[2012-05-29 12:33:38,210] - [remote_util:1034] INFO -
[2012-05-29 12:33:38,211] - [remote_util:1034] INFO - Please note that you have to update your firewall configuration to
[2012-05-29 12:33:38,211] - [remote_util:1034] INFO - allow connections to the following ports: 11211, 11210, 11209, 4369,
[2012-05-29 12:33:38,211] - [remote_util:1034] INFO - 8091 and from 21100 to 21299.
[2012-05-29 12:33:38,211] - [remote_util:1034] INFO -
[2012-05-29 12:33:38,212] - [remote_util:1034] INFO - By using this software you agree to the End User License Agreement.
[2012-05-29 12:33:38,212] - [remote_util:1034] INFO - See /opt/couchbase/LICENSE.txt.
[2012-05-29 12:33:38,212] - [remote_util:1034] INFO -
[2012-05-29 12:33:38,212] - [remote_util:1034] INFO - Processing triggers for ureadahead ...
[2012-05-29 12:33:38,213] - [remote_util:1053] INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp
[2012-05-29 12:33:38,303] - [remote_util:1082] INFO - command executed successfully
[2012-05-29 12:33:38,304] - [remote_util:1032] ERROR -
[2012-05-29 12:33:38,305] - [remote_util:1032] ERROR - ===============================================
[2012-05-29 12:33:38,306] - [remote_util:1032] ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been
[2012-05-29 12:33:38,306] - [remote_util:1032] ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running
[2012-05-29 12:33:38,307] - [remote_util:1032] ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf.
[2012-05-29 12:33:38,308] - [remote_util:1032] ERROR - ===============================================
[2012-05-29 12:33:38,309] - [remote_util:1032] ERROR -
[2012-05-29 12:33:38,309] - [remote_util:1053] INFO - running command.raw /etc/init.d/couchbase-server start
[2012-05-29 12:33:38,386] - [remote_util:1082] INFO - command executed successfully
[2012-05-29 12:33:38,387] - [remote_util:1034] INFO - * couchbase-server is already started
[2012-05-29 12:33:38,414] - [upgradetests:771] INFO - sleep for 10 seconds to wait for membase-server to start...
[2012-05-29 12:34:08,415] - [rest_client:499] INFO - settings/web params : username=Administrator&password=password&port=8091
[2012-05-29 12:34:08,440] - [rest_client:513] INFO - pools/default params : memoryQuota=3170&username=Administrator&password=password
[2012-05-29 12:34:08,536] - [cluster_helper:60] INFO - adding node : 10.3.121.92:8091 to the cluster
[2012-05-29 12:34:08,536] - [rest_client:618] INFO - adding remote node : 10.3.121.92 to this cluster @ : 10.3.121.98
[2012-05-29 12:34:09,235] - [rest_client:468] ERROR - http://10.3.121.98:8091/controller/addNode error 400 reason: unknown ["Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details."]
[2012-05-29 12:34:09,236] - [rest_client:640] ERROR - add_node error : ["Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details."]
ERROR
Attachments
For Gerrit Dashboard: MB-5402 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
16632,1 | MB-5402: avoid system_stats_collector crashing other services | branch-181 | ns_server | Status: MERGED | +2 | +1 |
16784,1 | MB-5402:fp: avoid system_stats_collector crashing other services | master | ns_server | Status: MERGED | +2 | +1 |
16825,1 | Merge commit '27fbb5333af2...' into branch-18 | branch-18 | ns_server | Status: MERGED | +2 | +1 |
16848,1 | Merge branch 'branch-18' | master | ns_server | Status: MERGED | +2 | +1 |