Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11765

Erlang error while stopping couchbase service on a node - ops/sec hits 0

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Major
    • 3.0-Beta
    • 3.0
    • ns_server
    • Security Level: Public
    • None
    • Untriaged
    • Unknown

    Description

      ersion: 3.0.0 enterprise edition (build-913)
      Ubuntu 12 x64 - 4 nodes with 2 cores and 14GB memory per node.

      behavior: error while stopping service under load (6K set ops/sec). Caused 10 seconds of 0 sets/sec even though this is 1 out of 4 nodes.
      expected behavior: no error and no outage on ops/sec on other nodes.

      azureuser@cbase-32:~$ sudo service couchbase-server stop
      {error_logger,2014,7,18},{15,49,20,"Protocol: ~tp: the name executioner@executioner seems to be in use by another Erlang node",["inet_tcp"]}
      {error_logger,2014,7,18},{15,49,20,crash_report,[[{initial_call,{net_kernel,init,['Argument__1']}},

      {pid,<0.21.0>}

      ,

      {registered_name,[]},{error_info,{exit,{error,badarg},[{gen_server,init_it,6,[{file,"gen_server.erl"},{line,320}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,239}]}]}},{ancestors,[net_sup,kernel_sup,<0.10.0>]},{messages,[]},{links,[#Port<0.53>,<0.18.0>]},{dictionary,[{longnames,true}]},{trap_exit,true},{status,running},{heap_size,610},{stack_size,27},{reductions,771}],[]]}
      {error_logger,2014,7,18},{15,49,20,supervisor_report,[{supervisor,{local,net_sup}},{errorContext,start_error},{reason,{'EXIT',nodistribution}},{offender,[{pid,undefined},{name,net_kernel},{mfargs,{net_kernel,start_link,[['executioner@executioner',longnames]]}},{restart_type,permanent},{shutdown,2000},{child_type,worker}]}]}
      {error_logger,2014,7,18},{15,49,20,supervisor_report,[{supervisor,{local,kernel_sup}},{errorContext,start_error},{reason,{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}}},{offender,[{pid,undefined},{name,net_sup},{mfargs,{erl_distribution,start_link,[]}},{restart_type,permanent},{shutdown,infinity},{child_type,supervisor}]}]}
      {error_logger,2014,7,18},{15,49,20,crash_report,[[{initial_call,{application_master,init,['Argument__1','Argument__2','Argument__3','Argument__4']}},{pid,<0.9.0>},{registered_name,[]}

      ,{error_info,{exit,{{shutdown,{failed_to_start_child,net_sup,{shutdown,{failed_to_start_child,net_kernel,

      {'EXIT',nodistribution}}}}},{kernel,start,[normal,[]]}},[{application_master,init,4,[{file,"application_master.erl"},{line,133}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,239}]}]}},{ancestors,[<0.8.0>]},{messages,[{'EXIT',<0.10.0>,normal}]},{links,[<0.8.0>,<0.7.0>]},{dictionary,[]},{trap_exit,true},{status,running},{heap_size,376},{stack_size,27},{reductions,117}],[]]}
      {error_logger,2014,7,18},{15,49,20,std_info,[{application,kernel},{exited,{{shutdown,{failed_to_start_child,net_sup,{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}

      }}}},

      {kernel,start,[normal,[]]}}},{type,permanent}]}
      {"Kernel pid terminated",application_controller,"{application_start_failure,kernel,shutdown,{failed_to_start_child,net_sup,{shutdown,{failed_to_start_child,net_kernel,{'EXIT',nodistribution}}},{kernel,start,[normal,[]]}

      }}"}

      Crash dump was written to: erl_crash.dump.1405698560.34968.babysitter
      Kernel pid terminated (application_controller) ({application_start_failure,kernel,{{shutdown,{failed_to_start_child,net_sup,{shutdown,{failed_to_start_child,net_kernel,

      {'EXIT',nodistribution}

      }}}},{k

      • Failed to stop couchbase-server
        azureuser@cbase-32:~$ sudo service couchbase-server stop
      • Failed to stop couchbase-server

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            alkondratenko Aleksey Kondratenko (Inactive)
            cihan Cihan Biyikoglu (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty