Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-8199

[Doc'd] many concurrent view requests cause excessive resource consumption and even crash

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0.1, 2.1.0
    • Fix Version/s: 2.2.0
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
    • Environment:
      4-core CPU, 16GB RAM, Linux
    • Operating System:
      Centos 64-bit

      Description

      In response to many view requests against the scatter/gather view merger, a node can allocate so many resources that it will fail to recover.

      In one case, this did cause many timeouts in the log leading to max_restart_intensity:
      [error_logger:error,2013-04-25T15:23:26.047,ns_1@10.128.16.171:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
      =========================SUPERVISOR REPORT=========================
      Supervisor:

      {local,ns_node_disco_sup}


      Context: shutdown
      Reason: reached_max_restart_intensity
      Offender: [

      {pid,<0.17237.774>}

      ,

      {name,ns_config_rep}

      ,
      {mfargs,{ns_config_rep,start_link,[]}},

      {restart_type,permanent}

      ,

      {shutdown,1000}

      ,

      {child_type,worker}

      ]

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        chiyoung Chiyoung Seo added a comment -

        Karen,

        Please close it if it is already resolved.

        Show
        chiyoung Chiyoung Seo added a comment - Karen, Please close it if it is already resolved.
        Hide
        kzeller kzeller added a comment - - edited

        Fixed link: In the past too many simultaneous views requests could overwhelm a node.
        You can now limit the number of simultaneous requests a node can receive. For
        more information, see REST-API, see <xref linkend="couchbase-restapi-request-limits" />.
        DOC'D FOR 2.1

        removing labeling until relevant for 2.2

        Show
        kzeller kzeller added a comment - - edited Fixed link: In the past too many simultaneous views requests could overwhelm a node. You can now limit the number of simultaneous requests a node can receive. For more information, see REST-API, see <xref linkend="couchbase-restapi-request-limits" />. DOC'D FOR 2.1 removing labeling until relevant for 2.2
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        renamed to ticket's subject to more accurately reflect it's nature. I.e. this is not strictly speaking a leak.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - renamed to ticket's subject to more accurately reflect it's nature. I.e. this is not strictly speaking a leak.
        Hide
        perry Perry Krug added a comment - - edited

        Karen, just one thing:
        -[FIXED] The release notes link on page 352 points to "Adjusting Rebalance during Compaction” but should be "8.8.1. Limiting Simultaneous Node Requests" right?

        Show
        perry Perry Krug added a comment - - edited Karen, just one thing: - [FIXED] The release notes link on page 352 points to "Adjusting Rebalance during Compaction” but should be "8.8.1. Limiting Simultaneous Node Requests" right?
        Hide
        perry Perry Krug added a comment -

        Has QE verified that this does in fact solve the problem?

        Show
        perry Perry Krug added a comment - Has QE verified that this does in fact solve the problem?

          People

          • Assignee:
            kzeller kzeller
            Reporter:
            ingenthr Matt Ingenthron
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes