Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-9224

[system test] [physical windows] couchbase server down due to "eheap_alloc: Cannot allocate 729810240 bytes of memory"

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 3.0
    • 2.2.0
    • ns_server
    • Security Level: Public
    • physical windows server 2008 R2 64bit
    • Windows 64-bit
    • I will post link to erlang crash dump

    Description

      Environment:
      2 windows server 2008 R2 SP1 64-bit (each server has 2 physical disks, 32 GB RAM, 4 core cpu)

      1:10.2.1.64
      2:10.2.1.65

      Cluster:
      2 nodes couchbase server 2.2.0-821 (RC#) cluster with 2 buckets
      defautlt bucket: 8 GB, 1 replica, 1 doc with 1 view
      sasl bucket: 8 GB, 1 replica, 1 doc with 1 view

      Testing:
      Load from 16 M items size from 128 to 512 bytes into each bucket.
      Continue to load until active resident ratio got 80%
      During loading, do update, delete, expiration and set items
      After more than 8 hours of load and access phase, node 64 crashed
      due to "eheap_alloc: Cannot allocate 729810240 bytes of memory (of type "heap")."

      Port server ns_server on node 'babysitter_of_ns_1@127.0.0.1' exited with status 255. Restarting. Messages: kernel-poll not supported; "K" parameter ignored
      Apache CouchDB 1.2.0a-386be73-git (LogLevel=info) is starting.
      Apache CouchDB has started. Time to relax.
      working as port
      Apache CouchDB 1.2.0a-386be73-git (LogLevel=info) is starting.
      Apache CouchDB has started. Time to relax.
      working as port

      Crash dump was written to: erl_crash.dump
      eheap_alloc: Cannot allocate 729810240 bytes of memory (of type "heap").

      This application has requested the Runtime to terminate it in an unusual way.
      Please contact the application's support team for more information.
      in message_loop ns_log000 ns_1@10.2.1.64 21:49:31 - Thu Oct 3, 2013
      Node 'ns_1@10.2.1.65' saw that node 'ns_1@10.2.1.64' went down. Details: [

      {nodedown_reason, net_tick_timeout}

      ] ns_node_disco005 ns_1@10.2.1.65 21:47:04 - Thu Oct 3, 2013
      Haven't heard from a higher priority node or a master, so I'm taking over. mb_master000 ns_1@10.2.1.65 21:46:03 - Thu Oct 3, 2013
      Bucket "sasl" loaded on node 'ns_1@10.2.1.65' in 0 seconds. ns_memcached001 ns_1@10.2.1.65 13:12:35 - Thu Oct 3, 2013
      Bucket "sasl" loaded on node 'ns_1@10.2.1.64' in 0 seconds. ns_memcached001 ns_1@10.2.1.64 13:12:33 - Thu Oct 3, 2013
      Created bucket "sasl" of type: membase
      [

      {num_replicas,1}, {replica_index,false}, {ram_quota,8388608000}, {auth_type,sasl}, {autocompaction,false}, {purge_interval,undefined}, {flush_enabled,false}, {num_threads,3}] menelaus_web012 ns_1@10.2.1.64 13:12:33 - Thu Oct 3, 2013
      Bucket "default" loaded on node 'ns_1@10.2.1.65' in 0 seconds. ns_memcached001 ns_1@10.2.1.65 13:10:55 - Thu Oct 3, 2013
      Bucket "default" loaded on node 'ns_1@10.2.1.64' in 0 seconds. ns_memcached001 ns_1@10.2.1.64 13:10:53 - Thu Oct 3, 2013
      Created bucket "default" of type: membase
      [{num_replicas,1}

      ,

      {replica_index,false}

      ,

      {ram_quota,8388608000}

      ,

      {auth_type,sasl}

      ,

      {autocompaction,false}

      ,

      {purge_interval,undefined}

      ,

      {flush_enabled,false}

      ,

      {num_threads,3}

      ] menelaus_web012 ns_1@10.2.1.64 13:10:53 - Thu Oct 3, 2013
      Deleting old data files of bucket "default" ns_storage_conf000 ns_1@10.2.1.65 13:09:45 - Thu Oct 3, 2013

      Link to manifest file http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.2.0-821-rel.setup.exe.manifest.xml

      This bug is the same as bug https://www.couchbase.com/issues/browse/MB-8957 except this time I tested them in physical server

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              Aliaksey Artamonau Aliaksey Artamonau (Inactive)
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty