Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43663

Ns_server crashes with status 1 due to failed memory allocate request

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.0.0
    • Cheshire-Cat
    • qe
    • Enterprise Edition 7.0.0 build 4214

    Description

      Build: 7.0.0 build 4214

      Scenario:

      • 9 Node cluster (5 kv + 2 fts + 2 gsi,n1ql)
      • 6 buckets with replica=1
      • Load 5K docs into each bucket
      • Create 50 GSI and 10 FTS index(fts_partitions=6) on each bucket
      • Created and dropped 400 GSI on bucket-0
      • Created and dropped 200 GSI on bucket-1

      Observation:

      Observed indexer crash(MB-43661) multiple times followed by ns_server crash with following logs in UI.

      Service 'ns_server' exited with status 1. Restarting. Messages:
      2021-01-15 08:57:31.045428 std_info #{label=>{error_logger,info_report},report=>{net_kernel,{'EXIT',<0.28567.14>,{recv_challenge_reply_failed,bad_cookie}}}}
      2021-01-15 08:57:31.045608 std_info #{label=>{error_logger,info_report},report=>{net_kernel,{net_kernel,1054,nodedown,'ns_1@172.23.104.224'}}}
      2021-01-15 08:57:32.081645
      args: ['ns_1@172.23.104.224']
      format: "** Connection attempt from disallowed node ~w ** ~n"
      label: {error_logger,error_msg}
      2021-01-15 08:57:32.082022 std_info #{label=>{error_logger,info_report},report=>{net_kernel,{'EXIT',<0.28651.14>,{recv_challenge_reply_failed,bad_cookie}}}}
      2021-01-15 08:57:32.082368 std_info #{label=>{error_logger,info_report},report=>{net_kernel,{net_kernel,1054,nodedown,'ns_1@172.23.104.224'}}}
      eheap_alloc: Cannot allocate 123210440 bytes of memory (of type "heap").
       
      Crash dump is being written to: erl_crash.dump.1610695204.122076.ns_server...done
      [os_mon] memory supervisor port (memsup): Erlang has closed
      [os_mon] cpu supervisor port (cpu_sup): Erlang has closed 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ashwin.govindarajulu Ashwin Govindarajulu
            ashwin.govindarajulu Ashwin Govindarajulu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty