Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11866

beam.smp RSS suddenly increases to 45GB after unexpected_binary error

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 3.0-Beta, 3.0
    • 3.0
    • view-engine
    • Security Level: Public
    • Build 3.0.0-1069

      Platform = Physical
      OS = CentOS 6.5
      CPU = Intel Xeon E5-2630 (24 vCPU)
      Memory = 64 GB
      Disk = 2 x SSD

    Description

      Mixed KV + queries rebalance test, 3 -> 4 nodes, 1 bucket x 100M x 2KB, 1 x 1 views, 10K ops/sec, 400 qps

      After almost 4 hours rebalance completed but then beam.smp memory started growing and eventually caused OOM situation.

      [couchdb:error,2014-08-01T0:31:05.986,ns_1@172.23.100.30:<0.30614.322>:couch_log:error:44]Uncaught error in HTTP request: {error,
      {badmatch,
      {unexpected_binary,

      {at,1158389762}

      ,

      {wanted_bytes,419601992}

      ,
      {got,2602207,

      Quite typical problem.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-11868 >10x regression in stale=false query latency

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pavelpaulau Pavel Paulau (Inactive)
              pavelpaulau Pavel Paulau (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty