Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-38683

cbbackup/cbtranster: Don't handle doc with very large rev

    XMLWordPrintable

Details

    • Triaged
    • Yes

    Description

      Problem
      When backing up documents with large rev cbbackup will crash:

      Traceback (most recent call last):
        File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 917, in _bootstrap_inner
          self.run()
        File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 865, in run
          self._target(*self._args, **self._kwargs)
        File "/opt/couchbase/lib/python/pump.py", line 446, in run_worker
          curx).run()
        File "/opt/couchbase/lib/python/pump.py", line 504, in run
          rv_batch, batch = self.source.provide_batch()
        File "/opt/couchbase/lib/python/pump_dcp.py", line 254, in provide_batch
          rv, batch = self.provide_dcp_batch_actual()
        File "/opt/couchbase/lib/python/pump_dcp.py", line 413, in provide_dcp_batch_actual
          msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(4, 'big'), val, seqno, dtype, metalen,
      OverflowError: int too big to convert
      

      This affects cbtransfer when dcp is being used.

      Steps to reproduce

      1. Create a document with a large rev
      2. Run cbbackup:

      Expectations
      For cbbackup to be able to back up all documents

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-38683
          # Subject Branch Project Status CR V

          Activity

            People

              thuan Thuan Nguyen
              pvarley Patrick Varley (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty