Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-2092

[TestBackupPVCResize] Backup event did not complete after PVC was resized.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.2.0
    • 2.2.0
    • operator
    • 12: Logging,Indexing, PE/SB
    • 1

    Description

      Job: http://qa.sc.couchbase.com/job/roo-test/194/console 

      Couchbase Server: couchbase/server:6.6.0

      Istio Enabled with MTLS_PERMISSIVE

      Storage class: standard-rwo

      Gerrit review for backup image: http://review.couchbase.org/c/couchbase-operator-backup/+/148816 

      Stack Trace: 

           --- FAIL: TestOperator/TestBackupPVCResize (1034.95s)
               crd_util.go:42: creating couchbase cluster: test-couchbase-zm2d9
               util.go:1170: context deadline exceeded: failed to wait for event BackupCompleted/Backup `full-only` completed
               util.go:1171: goroutine 802 [running]:
                   runtime/debug.Stack(0x1f0a905, 0xc0004b8480, 0xc0002b2000)
                   	/jenkins/workspace/roo-test/go/src/runtime/debug/stack.go:24 +0xab
                   github.com/couchbase/couchbase-operator/test/e2e/e2eutil.Die(0xc0009f6200, 0x29c66c0, 0xc000752a00)
                   	/jenkins/workspace/roo-test/test/e2e/e2eutil/util.go:1166 +0x34
                   github.com/couchbase/couchbase-operator/test/e2e/e2eutil.mustWaitForResourceEventFromNow(0xc0009f6200, 0xc0004bca90, 0x29d32e0, 0xc0004b8480, 0xc0002b2000, 0x8bb2c97000)
                   	/jenkins/workspace/roo-test/test/e2e/e2eutil/wait_util.go:289 +0x155
                   github.com/couchbase/couchbase-operator/test/e2e/e2eutil.MustWaitForBackupEvent(...)
                   	/jenkins/workspace/roo-test/test/e2e/e2eutil/wait_util.go:592
                   github.com/couchbase/couchbase-operator/test/e2e.testBackupPVCResize(0xc0009f6200, 0xc000612700)
                   	/jenkins/workspace/roo-test/test/e2e/backup_test.go:1037 +0xdc5
                   github.com/couchbase/couchbase-operator/test/e2e.TestBackupPVCResize(0xc0009f6200)
                   	/jenkins/workspace/roo-test/test/e2e/backup_test.go:1058 +0x3e
                   testing.tRunner(0xc0009f6200, 0x2703cf8)
                   	/jenkins/workspace/roo-test/go/src/testing/testing.go:909 +0x19a
                   created by testing.(*T).Run
                   	/jenkins/workspace/roo-test/go/src/testing/testing.go:960 +0x652              

      Event : https://github.com/couchbase/couchbase-operator/blob/master/test/e2e/backup_test.go#L1037 ** 

      cbbackupmgr did not have any Error message for the failure which might suggest this failure is a testware issue and we just have to increase the timeout period for the event. 

      NFO:root:Exiting Script, success. Output: Backed up to 2021-03-18T18_07_33.169097231Z
      Copied all data in 2.530934555s (Avg. 28.14KB/Sec)
      1 buckets, 100 items / 71.22KB
      Backup successfully completed
      Backed up bucket "default" succeeded
      Mutations backed up: 100, Mutations failed to backup: 0
      Deletions backed up: 0, Deletions failed to backup: 0
      Skipped due to purge number or conflict resolution: Mutations: 0 Deletions: 0
      2021-03-18 18:07:35,870 - root - INFO - Exiting Script, success. Output: Backed up to 2021-03-18T18_07_33.169097231Z
      Copied all data in 2.530934555s (Avg. 28.14KB/Sec)
      1 buckets, 100 items / 71.22KB
      Backup successfully completed
      Backed up bucket "default" succeeded
      Mutations backed up: 100, Mutations failed to backup: 0
      Deletions backed up: 0, Deletions failed to backup: 0
      Skipped due to purge number or conflict resolution: Mutations: 0 Deletions: 0 

      Attachments

        Activity

          People

            simon.murray Simon Murray
            prateek.kumar Prateek Kumar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty