Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6096

Index building is seemingly taking too much ram

    Details

      Description

      I have a crash dump that shows that simple index build over 1.2 million of small docs eats tons of ram. I'm going to attach erlang crash dump where you can see second biggest process (0.7277.2 or sort by stack+heap) is index updater.

      NOTE: crash itself was caused by attempt to grab diag so biggest process died because of that, but real cause seems to be index building.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -
        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Crash dump can be downloaded here: https://docs.google.com/open?id=0B6NtGsLhIcf7QVpwVldNcVlZdkk
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-couchdb-preview #474 (See http://qa.hq.northscale.net/job/github-couchdb-preview/474/)
        MB-6096 Fix too high memory consumption during indexing (Revision c8003e55b9dc8edbee51e5d047c0317aaf192560)

        Result = SUCCESS
        Filipe David Borba Manana :
        Files :

        • src/mapreduce/mapreduce.h
        • src/couchdb/couch_util.erl
        • src/couchdb/couch_db_updater.erl
        • src/mapreduce/mapreduce.cc
        • src/couch_set_view/src/couch_set_view_util.erl
        • src/couchdb/couch_doc.erl
        • src/couchdb/couch_btree.erl
        • src/couch_set_view/src/couch_set_view_updater.erl
        • src/mapreduce/mapreduce_nif.cc
        • src/mapreduce/mapreduce.erl
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-couchdb-preview #474 (See http://qa.hq.northscale.net/job/github-couchdb-preview/474/ ) MB-6096 Fix too high memory consumption during indexing (Revision c8003e55b9dc8edbee51e5d047c0317aaf192560) Result = SUCCESS Filipe David Borba Manana : Files : src/mapreduce/mapreduce.h src/couchdb/couch_util.erl src/couchdb/couch_db_updater.erl src/mapreduce/mapreduce.cc src/couch_set_view/src/couch_set_view_util.erl src/couchdb/couch_doc.erl src/couchdb/couch_btree.erl src/couch_set_view/src/couch_set_view_updater.erl src/mapreduce/mapreduce_nif.cc src/mapreduce/mapreduce.erl
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-couchdb-preview #475 (See http://qa.hq.northscale.net/job/github-couchdb-preview/475/)
        MB-6096 Use enif_alloc()/enif_free() in ejson decoder (Revision 2c4b88c46e1ce4500d987552e600eaa200546fe6)

        Result = SUCCESS
        Filipe David Borba Manana :
        Files :

        • src/ejson/decode.c
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-couchdb-preview #475 (See http://qa.hq.northscale.net/job/github-couchdb-preview/475/ ) MB-6096 Use enif_alloc()/enif_free() in ejson decoder (Revision 2c4b88c46e1ce4500d987552e600eaa200546fe6) Result = SUCCESS Filipe David Borba Manana : Files : src/ejson/decode.c
        Hide
        FilipeManana Filipe Manana (Inactive) added a comment -

        Re-opened to assign to myself, since I did all the investigation and code work

        Show
        FilipeManana Filipe Manana (Inactive) added a comment - Re-opened to assign to myself, since I did all the investigation and code work
        Hide
        FilipeManana Filipe Manana (Inactive) added a comment -

        Closing again.

        Show
        FilipeManana Filipe Manana (Inactive) added a comment - Closing again.

          People

          • Assignee:
            FilipeManana Filipe Manana (Inactive)
            Reporter:
            alkondratenko Aleksey Kondratenko (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes