Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10692

couch_stats_reader exit with timeout and then the memcached died

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Critical
    • 3.0
    • 2.1.0
    • ns_server
    • Security Level: Public
    • None
    • OS:OEL6.4 x86_64
      3nodes, 1G RAM per node.
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      The main error log as below:
      [error_logger:error,2014-03-06T15:45:05.981,ns_1@192.168.100.106:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-contacts' terminating

        • Last message in was refresh_stats
        • When Server state == {state,"contacts",undefined,undefined}
        • Reason for termination ==
        • {timeout,
          Unknown macro: {gen_server,call, [dir_size, {dir_size,"/opt/couchbase/var/lib/couchbase/data/contacts"}]}

          }

      [ns_server:info,2014-03-06T15:45:06.037,ns_1@192.168.100.106:ns_config_events<0.276.0>:ns_ports_setup:memcached_force_killer_fn:159]Sent force death command to own memcached:

      {send_to_port,<<"die!\n">>}

      [ns_server:info,2014-03-06T15:45:06.607,ns_1@192.168.100.106:<0.1512.0>:mc_connection:run_loop:202]mccouch connection was normally closed
      [ns_server:info,2014-03-06T15:45:06.609,ns_1@192.168.100.106:<0.16942.0>:mc_connection:run_loop:202]mccouch connection was normally closed
      [ns_server:info,2014-03-06T15:45:06.671,ns_1@192.168.100.106:<0.26822.1>:mc_connection:run_loop:202]mccouch connection was normally closed
      [error_logger:error,2014-03-06T15:45:06.926,ns_1@192.168.100.106:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
      =========================CRASH REPORT=========================
      crasher:
      initial call: erlang:apply/2
      pid: <0.4224.0>
      registered_name: []
      exception error: no match of right hand side value

      {error,closed}

      in function mc_client_binary:cmd_binary_vocal_recv/5
      in call from mc_client_binary:wait_for_checkpoint_persistence/3
      in call from ns_memcached:perform_wait_for_checkpoint_persistence/5
      ancestors: ['ns_memcached-usercenter','single_bucket_sup-usercenter',
      <0.1487.0>]
      messages: []
      links: <0.1501.0>,#Port<0.8699>
      dictionary: []
      trap_exit: false
      status: running
      heap_size: 121393
      stack_size: 24
      reductions: 11072
      neighbours:

      [rebalance:warn,2014-03-06T15:45:06.928,ns_1@192.168.100.106:<0.20193.3>:ebucketmigrator_srv:do_confirm_sent_messages:744]Got error while trying to read close ack:

      {error,einval}

      [ns_server:debug,2014-03-06T15:45:06.046,babysitter_of_ns_1@127.0.0.1:<0.81.0>:ns_port_server:handle_info:80]Sending the following to port: <<"die!\n">>
      [ns_server:info,2014-03-06T15:45:06.340,babysitter_of_ns_1@127.0.0.1:<0.81.0>:ns_port_server:log:168]memcached<0.81.0>: 'die!' on stdin. Exiting super-quickly

      [error_logger:error,2014-03-06T15:45:06.433,babysitter_of_ns_1@127.0.0.1:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.81.0> terminating

        • Last message in was {#Port<0.2964>,
          Unknown macro: {exit_status,0}

          }

        • When Server state == {state,#Port<0.2964>,memcached,
          {["'die!' on stdin. Exiting super-quickly",

      Attachments

        1. error.log
          681 kB
          lei
        2. info.log
          283 kB
          lei
        3. memcached.log.1.txt
          2.02 MB
          lei
        4. status.log
          38 kB
          lei
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            alkondratenko Aleksey Kondratenko (Inactive)
            lei lei
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty