Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-5371

Disconnected TAP producers should be purged from memory immediately

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.8.1-release-candidate
    • Fix Version/s: 1.8.1
    • Component/s: couchbase-bucket
    • Security Level: Public
    • Labels:

      Description

      From the large cluster, we observed that there are lots of disconnected TAP producers with large disk backfill queue after several rebalance attempts failed. Those producers are incrementally removed from the memory by removing 1000 items from their backfill queue. However, this incremental clean up caused heavy memory usage, which resulted in massive item evictions in a very short period. To prevent this from happening, we should remove those disconnected tap producers as soon as possible by the non-IO dispatcher. As the non-IO dispatcher is not involved in sending notifications to the pending memcached connections, this adaptation won't affect the frontend perfomance significantly.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Show
        chiyoung Chiyoung Seo added a comment - http://review.couchbase.org/#change,16358
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ep-engine-2-0 #293 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/293/)
        MB-5371 Clean up disconnected TAP producers immediately. (Revision 22fd1248db25d7ae45886c93d11147f5b8c7e21b)

        Result = SUCCESS
        Chiyoung Seo :
        Files :

        • tapconnection.hh
        • priority.cc
        • tapconnmap.cc
        • tapconnection.cc
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #293 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/293/ ) MB-5371 Clean up disconnected TAP producers immediately. (Revision 22fd1248db25d7ae45886c93d11147f5b8c7e21b) Result = SUCCESS Chiyoung Seo : Files : tapconnection.hh priority.cc tapconnmap.cc tapconnection.cc

          People

          • Assignee:
            chiyoung Chiyoung Seo
            Reporter:
            chiyoung Chiyoung Seo
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes