Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42359

cbbackupmgr hangs on EOF error

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • 7.0.0
    • 6.6.0
    • tools
    • None
    • Untriaged
    • 1
    • Unknown

    Description

      While investigating a workaround for MB-42352 I came across this issue.

      Problem
      cbbackupmgr hangs when there is a EOF error:

      cbbackupmgr hangs

      /opt/couchbase/bin/cbbackupmgr restore -a backup -r zombie  -c 10.112.201.101 -u Administrator -p password
      (1/1) Restoring backup 2020-10-29T15_05_45.745791997Z '2020-10-29T15_05_45.745791997Z'
      Transferring key value data for 'test' at 101B/s (about 0s remaining)                                                      1 items / 28.20KB
      [================================================================================================================================== ] 99.81%
      

      backup.logs

      2020-10-29T18:16:57.018+00:00 WARN: (Pool) (test) Failed to send document with key '<ud>test</ud>' because of an unexpected EOF -- couchbase.(*MemcachedWorker).processOperation() at pool_worker.go:350
      2020-10-29T18:16:57.018+00:00 WARN: (Pool) (test) Failed to send document with key '<ud>expiry</ud>' because of an unexpected EOF -- couchbase.(*MemcachedWorker).processOperation() at pool_worker.go:350
      2020-10-29T18:18:56.987+00:00 WARN: (Pool) (test) Memcached has been inactive for 1m0s, last item count 1 -- couchbase.(*MemcachedWorker).monitorActivity.func1() at pool_worker.go:411
      2020-10-29T18:21:45.746+00:00 Signal `interrupt` received, exiting
      

      Steps to reproduce

      Create the backup using a 6.0.4cluster and cbbackupmgr 6.6.0:
      1. Create a document with user xattrs and a 10 second TTL on Couchbase Server 6.0.3

       /opt/couchbase/bin/cbc-subdoc -U couchbase://localhost/test -u Administrator -P password
       subdoc> set test value -x xattr=100 -e 10
      

      2. Wait 10 seconds
      3. Take a backup

      /opt/couchbase/bin/cbbackupmgr config -a backup -r zombie
      /opt/couchbase/bin/cbbackupmgr backup -a backup -r zombie  -c 10.112.194.101 -u Administrator -p password
      

      For the restore setup a cluster on Couchbase Server 6.5.1, still using cbbackupmgr 6.6.0
      1. Change the allow_del_with_meta_prune_user_data config on the bucket

      /opt/couchbase/bin/cbepctl localhost:11210 -b test -u Administrator -p password set flush_param allow_del_with_meta_prune_user_data true
      

      2. Do the restore

      /opt/couchbase/bin/cbbackupmgr restore -a backup -r zombie  -c 10.112.201.101 -u Administrator -p password
      

      Expectations

      cbbackupmgr should not hang

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              james.lee James Lee
              pvarley Patrick Varley (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty