Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-38683

cbbackup/cbtranster: Don't handle doc with very large rev

    XMLWordPrintable

    Details

    • Triage:
      Triaged
    • Is this a Regression?:
      Yes

      Description

      Problem
      When backing up documents with large rev cbbackup will crash:

      Traceback (most recent call last):
        File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 917, in _bootstrap_inner
          self.run()
        File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 865, in run
          self._target(*self._args, **self._kwargs)
        File "/opt/couchbase/lib/python/pump.py", line 446, in run_worker
          curx).run()
        File "/opt/couchbase/lib/python/pump.py", line 504, in run
          rv_batch, batch = self.source.provide_batch()
        File "/opt/couchbase/lib/python/pump_dcp.py", line 254, in provide_batch
          rv, batch = self.provide_dcp_batch_actual()
        File "/opt/couchbase/lib/python/pump_dcp.py", line 413, in provide_dcp_batch_actual
          msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(4, 'big'), val, seqno, dtype, metalen,
      OverflowError: int too big to convert
      

      This affects cbtransfer when dcp is being used.

      Steps to reproduce

      1. Create a document with a large rev
      2. Run cbbackup:

      Expectations
      For cbbackup to be able to back up all documents

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.0-7685 contains couchbase-cli commit 597145c with commit message:
            MB-38683 Handle DCP mutations with Rev over 2^32

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.0-7685 contains couchbase-cli commit 597145c with commit message: MB-38683 Handle DCP mutations with Rev over 2^32
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.0-2503 contains couchbase-cli commit 597145c with commit message:
            MB-38683 Handle DCP mutations with Rev over 2^32

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-2503 contains couchbase-cli commit 597145c with commit message: MB-38683 Handle DCP mutations with Rev over 2^32
            Hide
            arunkumar Arunkumar Senthilnathan added a comment -

            Verification testcase up for review in CBQE-5619

            Show
            arunkumar Arunkumar Senthilnathan added a comment - Verification testcase up for review in CBQE-5619

              People

              Assignee:
              thuan Thuan Nguyen
              Reporter:
              pvarley Patrick Varley
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes

                    PagerDuty