Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-9075

cbtransfer shows incorrect count(after expiring some items) while transferring items from one bucket to another

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Won't Fix
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.5.0
    • Component/s: tools
    • Security Level: Public
    • Labels:
      None
    • Environment:
      Ubuntu-64 bit
      Build - RC3 - 2.2.0-821
    • Operating System:
      Ubuntu 64-bit

      Description

      When some items are expired in a bucket and then cbtransfer is used to transfer messages to another bucket, then total item count shown is wrong.

      To Reproduce:

      1. Take a node. Create Bucket. Load 100K items in it.
      2. Expire some items (in my case I expired 60%).
      3. Wait till items are expired (or run expiry pager). You will see that 40K items remains (I can see 40001 items on UI, so its correct).
      4. Execute the command :

      ./cbtransfer http://Administrator:password@10.3.3.59 http://Administrator:password@10.3.3.59:8091 -b default -B new_bucket -v -v

      5. UI shows that there are 40001 items in the new bucket (thats expected too).

      But in the output of cbtransfer, you will find (not pasting the complete output) :

      ############################################################################### 400.0% (159999/40001 msgs)

      So we see that around 160K items have been transferred, infact only 100K items were loaded initially and out of that 60K are already expired.

      Collectinfo at : http://s3.amazonaws.com/bugdb/jira/MB-9075/e9125b6b/collectinfo_cbtransfer.zip

        Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Show
          bcui Bin Cui (Inactive) added a comment - http://review.couchbase.org/#/c/29007/
          Hide
          bcui Bin Cui (Inactive) added a comment -

          cbtransfer will transfer not only active items, but also deleted items as well, which are decided by ep_engine.

          So the final 100K transferred items are expected.

          Show
          bcui Bin Cui (Inactive) added a comment - cbtransfer will transfer not only active items, but also deleted items as well, which are decided by ep_engine. So the final 100K transferred items are expected.
          Hide
          maria Maria McDuff (Inactive) added a comment -

          per PM, no need to be doc'd.

          Show
          maria Maria McDuff (Inactive) added a comment - per PM, no need to be doc'd.

            People

            • Assignee:
              bcui Bin Cui (Inactive)
              Reporter:
              shashank Shashank Gupta
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes