Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7406

too much memory (and cpu) consumption when building large spatial index (was: spatial indexer leaks ram by not destroying mapreduce contexts)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0
    • Fix Version/s: 2.1.0
    • Component/s: view-engine
    • Security Level: Public
    • Labels:
      None

      Description

      I.e. when trying to reproduce other bug I tried creating ddoc with just view and running it on about 700k docs and my node just died. It is perfectly reproducible, especially on i386 where address space is more limited.

      beam.smp dies by abort in V8 and message looks like this:

      #

      1. Fatal error in v8::ObjectTemplate::New()
      2. V8 is no longer usable
        #

      And by googling it appears that this may happen when running out of memory. We've also seen lots of threads in core dumps and our suspicion that mapreduce contexts are leaked was confirmed by grepping geocouch code.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        vmx Volker Mische added a comment -
        Show
        vmx Volker Mische added a comment - Rebased on 2.0.2 branch: http://review.couchbase.org/24830 http://review.couchbase.org/24831
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-couchdb-preview #566 (See http://qa.hq.northscale.net/job/github-couchdb-preview/566/)
        MB-7406: Add updater barrier for spatial indexer (Revision fb6316e699cc177a6d78fde20958a406f4d21ed3)

        Result = SUCCESS
        Filipe David Borba Manana :
        Files :

        • src/couchdb/couch_primary_sup.erl
        • etc/couchdb/default.ini.tpl.in
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-couchdb-preview #566 (See http://qa.hq.northscale.net/job/github-couchdb-preview/566/ ) MB-7406 : Add updater barrier for spatial indexer (Revision fb6316e699cc177a6d78fde20958a406f4d21ed3) Result = SUCCESS Filipe David Borba Manana : Files : src/couchdb/couch_primary_sup.erl etc/couchdb/default.ini.tpl.in
        Hide
        maria Maria McDuff (Inactive) added a comment -

        Deep, pls verify in current 2.0.2 build and close if passes. thanks.

        Show
        maria Maria McDuff (Inactive) added a comment - Deep, pls verify in current 2.0.2 build and close if passes. thanks.
        Hide
        deepkaran.salooja Deepkaran Salooja added a comment -

        Shashank, please verify with the steps detailed above.

        Show
        deepkaran.salooja Deepkaran Salooja added a comment - Shashank, please verify with the steps detailed above.
        Hide
        shashank Shashank Gupta added a comment -

        Followed the given steps with a cluster and with a single node too using the build 2.0.2-761. Worked well.

        Show
        shashank Shashank Gupta added a comment - Followed the given steps with a cluster and with a single node too using the build 2.0.2-761. Worked well.

          People

          • Assignee:
            shashank Shashank Gupta
            Reporter:
            alkondratenko Aleksey Kondratenko (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes