Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.8.0
    • Fix Version/s: 2.0-beta
    • Component/s: couchbase-bucket
    • Security Level: Public
    • Labels:
      None
    • Environment:
      centos 5.5, ec2 with EBS, 1.8.0

      Description

      During some testing with the Hadoop connector, we found that the TAP backfill remaining stat would show, correctly, the number of items during the memory portion of the backfill and then would start to vary between 0 and 1 per node. The theory is that it's showing backfill per vbucket (the disk backfill) as number of backfills running after the memory backfill completes.

      The full name of the stat is ep_tap_user_queue_backfillremaining.

      This can be rather confusing, as users will see a huge spike in items being backfilled followed by, what appears to be, not much of anything.

      The backfill runs correctly.

      Recommended solution is to convert the backfill remaining stat to either exact or approximate number of items remaining and make it work correctly for both memory and vbucket stats.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        I think right stat is ep_tap_replica_total_backlog_size which we use in replication up-to-dateness estimation code. But we need to confirm with Chiyoung.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - I think right stat is ep_tap_replica_total_backlog_size which we use in replication up-to-dateness estimation code. But we need to confirm with Chiyoung.
        Show
        chiyoung Chiyoung Seo added a comment - http://review.couchbase.org/#change,13344
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ep-engine-2-0 #195 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/195/)
        MB-4813 Maintain TAP backfill queue and backlog size separately. (Revision e46ce5a52db833ef4c00e78aac6531e2aef8297d)

        Result = SUCCESS
        Chiyoung Seo :
        Files :

        • tapconnection.cc
        • tapconnmap.cc
        • backfill.cc
        • tapconnmap.hh
        • tapconnection.hh
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ep-engine-2-0 #195 (See http://qa.hq.northscale.net/job/github-ep-engine-2-0/195/ ) MB-4813 Maintain TAP backfill queue and backlog size separately. (Revision e46ce5a52db833ef4c00e78aac6531e2aef8297d) Result = SUCCESS Chiyoung Seo : Files : tapconnection.cc tapconnmap.cc backfill.cc tapconnmap.hh tapconnection.hh

          People

          • Assignee:
            chiyoung Chiyoung Seo
            Reporter:
            ingenthr Matt Ingenthron
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes