Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58773

cbbackupmgr changes maxTTL from bucket default to 0

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 7.6.0
    • 7.6.0
    • tools
    • Untriaged
    • 0
    • Unknown

    Description

      Various backup tests are failing because

       

      "abs_high_seqno" changes from 4 to 5 after a restore, although the restore doesn't actually restore anything (no updates).

       

      Requested debug information by Matt:

      Before restore:
       
       curl http://localhost:8091/pools/default/buckets/default/scopes -u Administrator:password 
      {"uid":"1","scopes":[{"name":"_default","uid":"0","collections":[{"name":"_default","uid":"0","history":true}]},{"name":"_system","uid":"8","collections":[{"name":"_query","uid":"9","maxTTL":0,"history":false},{"name":"_mobile","uid":"8","maxTTL":0,"history":false}]}]}
       
       
      ./magma_dump /opt/couchbase/var/lib/couchbase/data/default/magma.0 --docs-by-seq --kvstore 0 --replay-wal --value --raw-key
      {"Key":{"ascii":"_scope","cid":8,"ns":1,"raw":"AQEIX3Njb3Bl"},"Meta":{"CAS":1695300376856166400,"bySeqno":1,"deleted":false,"uncompressedValueSize":40,"valueSize":40},"value":"EAAAAAAACgAMAAAABAAIAAoAAAAIAAAABAAAAAcAAABfc3lzdGVtAA=="}
      {"Key":{"ascii":"_collection","cid":9,"ns":1,"raw":"AQAJX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695300376856166401,"bySeqno":2,"deleted":false,"uncompressedValueSize":52,"valueSize":52},"value":"FAAAABAAFAAAAAgADAAHAAAAEAAQAAAAAAAAAQgAAAAJAAAABAAAAAYAAABfcXVlcnkAAA=="}
      {"Key":{"ascii":"_collection","cid":8,"ns":1,"raw":"AQAIX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695300376856166402,"bySeqno":3,"deleted":false,"uncompressedValueSize":64,"valueSize":64},"value":"FAAAABAAIAAUAAgADAAHAAAAEAAQAAAAAAAAAQgAAAAIAAAAEAAAAAEAAAAAAAAAAAAAAAcAAABfbW9iaWxlAA=="}
      {"Key":{"ascii":"_collection","cid":0,"ns":1,"raw":"AQIAX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695300376856231936,"bySeqno":4,"deleted":false,"uncompressedValueSize":121,"valueSize":121},"value":"AAAANQAAADFfZGVmYXVsdF9jb2xsZWN0aW9uX2xlZ2FjeQB7Im1heF9kY3Bfc2Vxbm8iOiIwIn0AHAAAAAAAAAAAABIAFAAMAAAAAAAAAAAACAAHABIAAAAAAAABDAAAAAEAAAAAAAAACAAAAF9kZWZhdWx0AAAAAA==","xattr":{"_default_collection_legacy":{"max_dcp_seqno":"0"}}}
       
       
       
       
      After restore:
       
      curl http://localhost:8091/pools/default/buckets/default/scopes -u Administrator:password 
      {"uid":"2","scopes":[{"name":"_default","uid":"0","collections":[{"name":"_default","maxTTL":0,"uid":"0","history":true}]},{"name":"_system","uid":"8","collections":[{"name":"_query","uid":"9","maxTTL":0,"history":false},{"name":"_mobile","uid":"8","maxTTL":0,"history":false}]}]}
       
       
      ./magma_dump /opt/couchbase/var/lib/couchbase/data/default/magma.0 --docs-by-seq --kvstore 0 --replay-wal --value --raw-key
      {"Key":{"ascii":"_scope","cid":8,"ns":1,"raw":"AQEIX3Njb3Bl"},"Meta":{"CAS":1695300376856166400,"bySeqno":1,"deleted":false,"uncompressedValueSize":40,"valueSize":40},"value":"EAAAAAAACgAMAAAABAAIAAoAAAAIAAAABAAAAAcAAABfc3lzdGVtAA=="}
      {"Key":{"ascii":"_collection","cid":9,"ns":1,"raw":"AQAJX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695300376856166401,"bySeqno":2,"deleted":false,"uncompressedValueSize":52,"valueSize":52},"value":"FAAAABAAFAAAAAgADAAHAAAAEAAQAAAAAAAAAQgAAAAJAAAABAAAAAYAAABfcXVlcnkAAA=="}
      {"Key":{"ascii":"_collection","cid":8,"ns":1,"raw":"AQAIX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695300376856166402,"bySeqno":3,"deleted":false,"uncompressedValueSize":64,"valueSize":64},"value":"FAAAABAAIAAUAAgADAAHAAAAEAAQAAAAAAAAAQgAAAAIAAAAEAAAAAEAAAAAAAAAAAAAAAcAAABfbW9iaWxlAA=="}
      {"Key":{"ascii":"_collection","cid":0,"ns":1,"raw":"AQIAX2NvbGxlY3Rpb24="},"Meta":{"CAS":1695301665289863168,"bySeqno":5,"deleted":false,"uncompressedValueSize":121,"valueSize":121},"value":"AAAANQAAADFfZGVmYXVsdF9jb2xsZWN0aW9uX2xlZ2FjeQB7Im1heF9kY3Bfc2Vxbm8iOiIwIn0AHAAAAAAAAAAAABIAFAAMAAAAAAAGAAAACAAHABIAAAAAAAEBDAAAAAIAAAAAAAAACAAAAF9kZWZhdWx0AAAAAA==","xattr":{"_default_collection_legacy":{"max_dcp_seqno":"0"}}}
       
       
       
       
       
       
       
       
       
      ./cbbackupmgr restore --archive /tmp/entbackup_172.23.136.178 --repo backup --cluster http://172.23.136.178:8091 --username Administrator  --password password
      Restoring backup '2023-09-21T05_51_30.891496109-07_00'
      Copied all data in 3.382s (Avg. 50.91KiB/Sec)                                              1000 items / 152.74KiB
      [=======================================================================================================] 100.00%
       
      | Transfer
      | --------
      | Status    | Avg Transfer Rate | Started At                      | Finished At                     | Duration |
      | Succeeded | 50.91KiB/s        | Thu, 21 Sep 2023 06:07:45 -0700 | Thu, 21 Sep 2023 06:07:48 -0700 | 3.447s   |
       
      | Warnings                                                                                  |
      | --------                                                                                  |
      | Restore has skipped some users and/or groups. Please check the logs for more information. |
       
      | Bucket
      | ------
      | Name    | Status    | Transferred | Avg Transfer Rate | Started At                      | Finished At                     | Duration |
      | default | Succeeded | 152.74KiB   | 76.37KiB/s        | Thu, 21 Sep 2023 06:07:45 -0700 | Thu, 21 Sep 2023 06:07:48 -0700 | 2.632s   |
      |
      | Mutations                    | Deletions                    | Expirations                  |
      | ---------                    | ---------                    | -----------                  |
      | Received | Errored | Skipped | Received | Errored | Skipped | Received | Errored | Skipped |
      | 0        | 0       | 1000    | 0        | 0       | 0       | 0        | 0       | 0       |
       
      Restore completed successfully 

      To reproduce:

       

      ./testrunner -i ~/work/ini/neo.ini -p get-coredumps=False,force_kill_memached=True,verify_unacked_bytes=True,get-cbcollect-info=True,sirius_url=http://172.23.120.103:4000 -t ent_backup_restore.enterprise_backup_restore_test.EnterpriseBackupRestoreTest.test_backup_restore_with_update_notifications,items=1000,GROUP=P0

       

       

      This is probably a dup to MB-58209

      Attachments

        1. backup_logs.tar
          258 kB
          Gilad Kalchheim

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              gilad.kalchheim Gilad Kalchheim
              gilad.kalchheim Gilad Kalchheim
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty