Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37866

cbbackupmgr: Restore hangs from a pre 6.5.0 sqlite backup

    XMLWordPrintable

Details

    • Untriaged
    • Unknown

    Description

      Problem
      For performance tests we have a backup made that is restored before each test in a certain suite. We run this suite of tests for 6.0.4, 6.5.0, 6.5.1, and 7.0.0. Restore does not work for all four versions.

      7.0.0 - http://perf.jenkins.couchbase.com/job/hebe/5954/ - works
      6.5.0 - http://perf.jenkins.couchbase.com/job/hebe/5965/ - doesnt
      6.5.1 - http://perf.jenkins.couchbase.com/job/hebe/5966/ - doesnt
      6.0.4 - http://perf.jenkins.couchbase.com/job/hebe/5967/ - works

      Here is what the backup repo looks like:

      [root@172-23-100-204 backups]# ls -la
       
      total 8
      drwxr-xr-x   4 root root   47 Feb 11 10:22 .
      dr-xr-xr-x. 24 root root 4096 Dec 21 17:11 ..
      -rw-rw----   1 root root   19 Jul 30  2019 .backup
      drwxrwx---   2 root root   44 Jan 20 14:41 logs
      drwxrwx---   3 root root   73 Jan 20 14:26 soe10M
       
      [root@172-23-100-204 backups]# cat .backup 
      {
        "version": 1
      }
       
       
      [root@172-23-100-204 backups]# cd soe10M/
      [root@172-23-100-204 soe10M]# ls -la
      total 4
      drwxrwx--- 3 root root  73 Jan 20 14:26 .
      drwxr-xr-x 4 root root  47 Feb 11 10:22 ..
      drwxrwx--- 3 root root 107 Jan 20 14:30 2020-01-20T14_26_39.095735135-08_00
      -rw-rw---- 1 root root 491 Jan 20 14:26 backup-meta.json
       
       
      [root@172-23-100-204 soe10M]# cat backup-meta.json 
      {
        "exclude_buckets": [],
        "include_buckets": [],
        "exclude_collections": [],
        "include_collections": [],
        "filter_keys": "",
        "filter_values": "",
        "disable_cluster_config": true,
        "disable_bucket_config": false,
        "disable_views": false,
        "disable_gsi_indexes": false,
        "disable_queries": true,
        "disable_ft_indexes": false,
        "disable_data": false,
        "disable_eventing": false,
        "allow_bucket_creation": false,
        "filter_vbuckets": {
          "list": [],
          "enabled": false
        }
      }
       
      [root@172-23-100-204 2020-01-20T14_26_39.095735135-08_00]# ls -la
      total 12
      drwxrwx--- 3 root root  107 Jan 20 14:30 .
      drwxrwx--- 3 root root   73 Jan 20 14:26 ..
      drwxrwx--- 3 root root  144 Jan 20 14:26 bucket-1-62951419f66ff68c2a7f7e8c5cb23839
      -rw-rw---- 1 root root    4 Jan 20 14:30 events.json
      -rw-rw---- 1 root root 3030 Jan 20 14:30 plan.json
      -rw-rw---- 1 root root   18 Jan 20 14:26 .version
       
       
      [root@172-23-100-204 2020-01-20T14_26_39.095735135-08_00]# cat .version 
      {
        "version": 2
      }
      

       
      Steps to reproduce

      1. Create a backup using Couchbase Server/cbbackupmgr 6.0.0 with the unsupported and undocumented option --format sqlite
      2. Restore using Couchbase Server/cbackupmgr 6.5.X, it will hang.

      Work around
      Do you not use --storage sqlite flag when creating the backup.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build couchbase-server-7.0.0-1395 contains backup commit 640bd44 with commit message:
            MB-37866 Fixed hang caused by contended mutex lock

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-1395 contains backup commit 640bd44 with commit message: MB-37866 Fixed hang caused by contended mutex lock

            Build couchbase-server-7.0.0-1395 contains backup commit 296ac93 with commit message:
            MB-37866 Fixed an issue which caused 'lastseqno' to always be zero

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-1395 contains backup commit 296ac93 with commit message: MB-37866 Fixed an issue which caused 'lastseqno' to always be zero
            wayne Wayne Siu added a comment -

            Tested with build 6.5.1-6278, tests are working now.

            wayne Wayne Siu added a comment - Tested with build 6.5.1-6278, tests are working now.

            Build couchbase-server-1006.5.1-1125 contains backup commit 640bd44 with commit message:
            MB-37866 Fixed hang caused by contended mutex lock

            build-team Couchbase Build Team added a comment - Build couchbase-server-1006.5.1-1125 contains backup commit 640bd44 with commit message: MB-37866 Fixed hang caused by contended mutex lock

            Build couchbase-server-1006.5.1-1125 contains backup commit 296ac93 with commit message:
            MB-37866 Fixed an issue which caused 'lastseqno' to always be zero

            build-team Couchbase Build Team added a comment - Build couchbase-server-1006.5.1-1125 contains backup commit 296ac93 with commit message: MB-37866 Fixed an issue which caused 'lastseqno' to always be zero

            People

              korrigan.clark Korrigan Clark
              korrigan.clark Korrigan Clark
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty