Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-3286

Possible problem in backup for S3

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.6.0
    • None
    • None
    • None
    • 1

    Description

      Two BackupToS3 tests are failing in version 2.6.0:

       

      custom.TestBackupAndRestoreExcludeBucketsS3
      		 
      custom.TestBackupAndRestoreDisableEventingS3

      The test error:

       

      Error Messagecontext deadline exceeded: failed to wait for event BackupStarted/Backup `backup-6smkb` startedStacktracegoroutine 459 [running]:
      		 
      runtime/debug.Stack()
      		 
      	runtime/debug/stack.go:24 +0x72
      		 
      github.com/couchbase/couchbase-operator/test/e2e/e2eutil.Die(0xc000b52340, {0x6adf2e0, 0xc00189aea0})
      		 
      	github.com/couchbase/couchbase-operator/test/e2e/e2eutil/util.go:1424 +0x36
      		 
      github.com/couchbase/couchbase-operator/test/e2e/e2eutil.mustWaitForResourceEventFromNow(0xc002215984?, 0xc?, {0x6aeffb8, 0xc0021cc840}, 0x9?, 0x0?)
      		 
      	github.com/couchbase/couchbase-operator/test/e2e/e2eutil/wait_util.go:315 +0xfd
      		 
      github.com/couchbase/couchbase-operator/test/e2e/e2eutil.MustWaitForBackupEvent(...)
      		 
      	github.com/couchbase/couchbase-operator/test/e2e/e2eutil/wait_util.go:613
      		 
      github.com/couchbase/couchbase-operator/test/e2e.testBackupAndRestoreExcludeBuckets(0xc000b52340, 0x0?)
      		 
      	github.com/couchbase/couchbase-operator/test/e2e/backup_test.go:1903 +0x12db
      		 
      github.com/couchbase/couchbase-operator/test/e2e.TestBackupAndRestoreExcludeBucketsS3(0x0?)
      		 
      	github.com/couchbase/couchbase-operator/test/e2e/backup_test.go:1949 +0x34
      		 
      testing.tRunner(0xc000b52340, 0x55dd400)
      		 
      	testing/testing.go:1576 +0x217
      		 
      created by testing.(*T).Run
      		 
      	testing/testing.go:1629 +0x806

       

      In the logs I see:

       
      {"level":"error","ts":"2023-11-22T08:56:55Z","logger":"cluster","msg":"Reconciliation failed","cluster":"test-cls2q/test-couchbase-kwcks","error":"failed to populate removal queue for server class 'default': strconv.ParseInt: parsing \"5685328.5\": invalid syntax: error converting 5685328.5 to int64 format: error calculating member disk size","stacktrace":"github.com/couchbase/couchbase-operator/pkg/cluster.(*Cluster).runReconcile\n\tgithub.com/couchbase/couchbase-operator/pkg/cluster/cluster.go:498\ngithub.com/couchbase/couchbase-operator/pkg/cluster.(*Cluster).Update\n\tgithub.com/couchbase/couchbase-operator/pkg/cluster/cluster.go:535\ngithub.com/couchbase/couchbase-operator/pkg/controller.(*CouchbaseClusterReconciler).Reconcile\n\tgithub.com/couchbase/couchbase-operator/pkg/controller/
       

      I've attached the logs. It a possible regression in 2.6.0

      Justin Ashworth 

       

      Attachments

        Issue Links

          is subtask of

          Page - A new page either standalone or within a series of pages must be added K8S-3226 2.6.0 Test Regressions Tracking

          • Major - Major loss of function.
          • Closed
          For Gerrit Dashboard: K8S-3286
          # Subject Branch Project Status CR V
          201454,2 K8S-3286: Parse metrics as floats master couchbase-operator Status: MERGED +2 +1

          Activity

            People

              usamah.jassat Usamah Jassat
              gilad.kalchheim Gilad Kalchheim
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty