Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7030

Improve performance of view engine for rebalance with consistent views enabled, and make it use less resources (CPU, IO)

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0
    • Component/s: view-engine
    • Security Level: Public
    • Labels:
      None

      Description

      The goal here is to make rebalance, with consistent views enabled, faster and consume less CPU and ideally do less IO as well.

      This relates to MB-6799.

      Each commit will be very specific describing each improvement. Some of them, as a side effect, will also improve rebalance with consistent views disabled.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        FilipeManana Filipe Manana (Inactive) created issue -
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-couchdb-preview #527 (See http://qa.hq.northscale.net/job/github-couchdb-preview/527/)
        MB-7030 Always send new group snapshot to parent (Revision 2f17fe571193d00c6c4ee8522710903e3fe7052f)
        MB-7030 Use some cheaper BIFs for list and orddicts (Revision a2bef2f295fbc198d9206a2a4d0cc28c025af56e)
        MB-7030 Check mail box for new group snapshot (Revision c2dd289640f1097d8a9b285e25004cdaadc07196)
        MB-7030 Avoid not useful anymore header commit (Revision a0b3bb69a9a1f0c62a36f622db16cb8c928a1b81)
        MB-7030 Don't fsync when doing some header commits (Revision aa361e5de8d129a8244503ee3d0d11bfdef17794)
        MB-7030 Don't restart cleanup process (Revision d2eb7d5e4f5cac7f0533bb7c793180fbc67f0447)
        MB-7030 Avoid unnecessary group pid lookup (Revision 1a5f6290bc21a37a4eb3bf4be75f4e5c995e05cf)

        Result = SUCCESS
        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_updater.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_group.erl
        • src/couch_set_view/src/couch_set_view_util.erl
        • src/couch_set_view/src/couch_set_view_updater.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_group.erl
        • src/couch_set_view/src/couch_set_view_updater.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_group.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_group.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view_group.erl

        steve :
        Files :

        • src/couch_set_view/src/couch_set_view.erl
        • src/couch_set_view/src/couch_set_view_group.erl
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-couchdb-preview #527 (See http://qa.hq.northscale.net/job/github-couchdb-preview/527/ ) MB-7030 Always send new group snapshot to parent (Revision 2f17fe571193d00c6c4ee8522710903e3fe7052f) MB-7030 Use some cheaper BIFs for list and orddicts (Revision a2bef2f295fbc198d9206a2a4d0cc28c025af56e) MB-7030 Check mail box for new group snapshot (Revision c2dd289640f1097d8a9b285e25004cdaadc07196) MB-7030 Avoid not useful anymore header commit (Revision a0b3bb69a9a1f0c62a36f622db16cb8c928a1b81) MB-7030 Don't fsync when doing some header commits (Revision aa361e5de8d129a8244503ee3d0d11bfdef17794) MB-7030 Don't restart cleanup process (Revision d2eb7d5e4f5cac7f0533bb7c793180fbc67f0447) MB-7030 Avoid unnecessary group pid lookup (Revision 1a5f6290bc21a37a4eb3bf4be75f4e5c995e05cf) Result = SUCCESS steve : Files : src/couch_set_view/src/couch_set_view_updater.erl steve : Files : src/couch_set_view/src/couch_set_view_group.erl src/couch_set_view/src/couch_set_view_util.erl src/couch_set_view/src/couch_set_view_updater.erl steve : Files : src/couch_set_view/src/couch_set_view_group.erl src/couch_set_view/src/couch_set_view_updater.erl steve : Files : src/couch_set_view/src/couch_set_view_group.erl steve : Files : src/couch_set_view/src/couch_set_view_group.erl steve : Files : src/couch_set_view/src/couch_set_view_group.erl steve : Files : src/couch_set_view/src/couch_set_view.erl src/couch_set_view/src/couch_set_view_group.erl
        Hide
        steve Steve Yen added a comment -

        resolving this per bug-scrub mtg

        Show
        steve Steve Yen added a comment - resolving this per bug-scrub mtg
        steve Steve Yen made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        FilipeManana Filipe Manana (Inactive) added a comment -

        I thought this was still not close to the goals, that's why it remained open.

        Show
        FilipeManana Filipe Manana (Inactive) added a comment - I thought this was still not close to the goals, that's why it remained open.
        mikew Mike Wiederhold made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            FilipeManana Filipe Manana (Inactive)
            Reporter:
            FilipeManana Filipe Manana (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes