Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10692

couch_stats_reader exit with timeout and then the memcached died

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Critical
    • 3.0
    • 2.1.0
    • ns_server
    • Security Level: Public
    • None
    • OS:OEL6.4 x86_64
      3nodes, 1G RAM per node.
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      The main error log as below:
      [error_logger:error,2014-03-06T15:45:05.981,ns_1@192.168.100.106:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-contacts' terminating

        • Last message in was refresh_stats
        • When Server state == {state,"contacts",undefined,undefined}
        • Reason for termination ==
        • {timeout,
          Unknown macro: {gen_server,call, [dir_size, {dir_size,"/opt/couchbase/var/lib/couchbase/data/contacts"}]}

          }

      [ns_server:info,2014-03-06T15:45:06.037,ns_1@192.168.100.106:ns_config_events<0.276.0>:ns_ports_setup:memcached_force_killer_fn:159]Sent force death command to own memcached:

      {send_to_port,<<"die!\n">>}

      [ns_server:info,2014-03-06T15:45:06.607,ns_1@192.168.100.106:<0.1512.0>:mc_connection:run_loop:202]mccouch connection was normally closed
      [ns_server:info,2014-03-06T15:45:06.609,ns_1@192.168.100.106:<0.16942.0>:mc_connection:run_loop:202]mccouch connection was normally closed
      [ns_server:info,2014-03-06T15:45:06.671,ns_1@192.168.100.106:<0.26822.1>:mc_connection:run_loop:202]mccouch connection was normally closed
      [error_logger:error,2014-03-06T15:45:06.926,ns_1@192.168.100.106:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
      =========================CRASH REPORT=========================
      crasher:
      initial call: erlang:apply/2
      pid: <0.4224.0>
      registered_name: []
      exception error: no match of right hand side value

      {error,closed}

      in function mc_client_binary:cmd_binary_vocal_recv/5
      in call from mc_client_binary:wait_for_checkpoint_persistence/3
      in call from ns_memcached:perform_wait_for_checkpoint_persistence/5
      ancestors: ['ns_memcached-usercenter','single_bucket_sup-usercenter',
      <0.1487.0>]
      messages: []
      links: <0.1501.0>,#Port<0.8699>
      dictionary: []
      trap_exit: false
      status: running
      heap_size: 121393
      stack_size: 24
      reductions: 11072
      neighbours:

      [rebalance:warn,2014-03-06T15:45:06.928,ns_1@192.168.100.106:<0.20193.3>:ebucketmigrator_srv:do_confirm_sent_messages:744]Got error while trying to read close ack:

      {error,einval}

      [ns_server:debug,2014-03-06T15:45:06.046,babysitter_of_ns_1@127.0.0.1:<0.81.0>:ns_port_server:handle_info:80]Sending the following to port: <<"die!\n">>
      [ns_server:info,2014-03-06T15:45:06.340,babysitter_of_ns_1@127.0.0.1:<0.81.0>:ns_port_server:log:168]memcached<0.81.0>: 'die!' on stdin. Exiting super-quickly

      [error_logger:error,2014-03-06T15:45:06.433,babysitter_of_ns_1@127.0.0.1:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.81.0> terminating

        • Last message in was {#Port<0.2964>,
          Unknown macro: {exit_status,0}

          }

        • When Server state == {state,#Port<0.2964>,memcached,
          {["'die!' on stdin. Exiting super-quickly",

      Attachments

        1. error.log
          681 kB
        2. info.log
          283 kB
        3. memcached.log.1.txt
          2.02 MB
        4. status.log
          38 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            alkondratenko Aleksey Kondratenko (Inactive)
            lei lei
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty