Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-670

upgrading operator from 1.0 to 1.1 manually fails with panic in the logs

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 1.1.0
    • None
    • operator
    • None

    Description

      Steps:

      1. Setup a K8S cluster
      2. Deploy 1.0.0-448 operator
      3. Deploy the secret and cb cluster enterprise-5.5.1
      4. Apply crd.yaml
      5. kubectl edit deployment couchbase-operator - change version to 1.1.0-526
      6. status of deployment - error - panic observed in the logs

      panic: failed to decode json data with gvk(couchbase.com/v1, Kind=CouchbaseCluster): v1.CouchbaseCluster.Status: v1.ClusterStatus.Members: v1.MembersStatus.Ready: v1.MemberStatusList: ReadString: expects " or n, but found {, error found in #10 byte of ...|"ready":[{"Name":"cb|..., bigger context ...|Features":["xdcr"],"members":{"index":3,"ready":[{"Name":"cb-example-0000"},{"Name":"cb-example-0001|... [recovered]
      	panic: failed to decode json data with gvk(couchbase.com/v1, Kind=CouchbaseCluster): v1.CouchbaseCluster.Status: v1.ClusterStatus.Members: v1.MembersStatus.Ready: v1.MemberStatusList: ReadString: expects " or n, but found {, error found in #10 byte of ...|"ready":[{"Name":"cb|..., bigger context ...|Features":["xdcr"],"members":{"index":3,"ready":[{"Name":"cb-example-0000"},{"Name":"cb-example-0001|...
      goroutine 69 [running]:
      github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:58 +0x111
      panic(0x11726a0, 0xc4204d2060)
      	/usr/local/go/1.9/go/src/runtime/panic.go:491 +0x283
      github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/util/k8sutil.RuntimeObjectFromUnstructured(0xc420566088, 0xc420566088, 0x12)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/util/k8sutil/k8sutil.go:69 +0x3a9
      github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.(*informer).sync(0xc4207f4600, 0xc42036d720, 0x12, 0x112ede0, 0xc4205e90f0)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/sync.go:78 +0xcc
      github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.(*informer).processNextItem(0xc4207f4600, 0x811700)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/sync.go:53 +0xd2
      github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.(*informer).runWorker(0xc4207f4600)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/sync.go:37 +0x2b
      github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.(*informer).(github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.runWorker)-fm()
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:88 +0x2a
      github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4205e9110)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
      github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4205e9110, 0x3b9aca00, 0x0, 0x1, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
      github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4205e9110, 0x3b9aca00, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
      created by github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer.(*informer).Run
      	/home/couchbase/jenkins/workspace/couchbase-operator-build/goproj/src/github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:88 +0x21e
      [root@k8s-master-1 example]#
      

      Attachments

        Activity

          People

            mikew Mike Wiederhold [X] (Inactive)
            arunkumar Arunkumar Senthilnathan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty