Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-1287

pools/default becomes unavailable after a node is killed in a 3 node cluster

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • 1.6.0 beta1
    • 1.6.0 beta1
    • UI
    • None
    • Operating System: All
      Platform: All

    Description

      1.6.0a-62
      EC2
      CentOS 5.2 x86_64
      3 node server
      Web browser: Firefox

      1) Create a 3 node cluster
      2) ssh into one of the nodes
      3) kill off membase (I used rpm -e northscale-server)
      4) Refresh the web of one of the remaining nodes
      5) Servers no longer show up, from firebug it looks like http://<ip>/pools/default is no longer accessible

      From the logs:

      Server error during processing: ["web request failed",

      {path,"/pools/default"}

      ,

      {type,exit}

      , {what, {timeout, {gen_server,call, [

      {global,'ns_orchestrator-default'}

      , rebalance_progress]}}}, {trace, [

      {gen_server,call,2}

      ,

      {menelaus_web,build_pool_info,4}

      ,

      {menelaus_web,handle_pool_info,2}

      ,

      {menelaus_web,loop,3}

      ,

      {mochiweb_http,headers,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}] menelaus_web019 01:28:12 - Tue Jun 22, 2010
      Node 'ns_1@10.222.246.159' saw that node 'ns_1@10.252.94.4' went down. ns_node_disco005 01:27:51 - Tue Jun 22, 2010
      Node 'ns_1@10.252.79.32' saw that node 'ns_1@10.252.94.4' went down. ns_node_disco005 01:27:51 - Tue Jun 22, 2010

      Attachments

        1. log.txt
          141 kB
          Steve Yen

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sean@northscale.com Sean Lynch (Inactive)
              kbatten@gmail.com kbatten@gmail.com
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty