Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-523

Unable to deploy couchbase-cluster using latest operator image

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Test Blocker
    • Resolution: Done
    • 1.0.0
    • 1.0.0
    • testing

    Description

      Below prints are seen as soon as we deploy the couchbase cluster through our operator

      ec2-user@ip-172-16-0-187 couchbase-operator]$ kubectl logs deployment/couchbase-operator
      time="2018-08-09T11:55:23Z" level=info msg="couchbase-operator v1.0.0 (release)" module=main
      time="2018-08-09T11:55:23Z" level=info msg="Obtaining resource lock" module=main
      time="2018-08-09T11:55:23Z" level=info msg="Starting event recorder" module=main
      time="2018-08-09T11:55:23Z" level=info msg="Attempting to be elected the couchbase-operator leader" module=main
      time="2018-08-09T11:55:41Z" level=info msg="Event(v1.ObjectReference{Kind:\"Endpoints\", Namespace:\"default\", Name:\"couchbase-operator\", UID:\"8a549a98-9a6f-11e8-bae9-0a72e2cc26a0\", APIVersion:\"v1\", ResourceVersion:\"2299496\", FieldPath:\"\"}): type: 'Normal' reason: 'LeaderElection' couchbase-operator-59bfd6bb4d-qsjjn became leader" module=event_recorder
      time="2018-08-09T11:55:41Z" level=info msg="I'm the leader, attempt to start the operator" module=main
      time="2018-08-09T11:55:41Z" level=info msg="Creating the couchbase-operator controller" module=main
      time="2018-08-09T11:55:41Z" level=info msg="CRD initialized, listening for events..." module=controller
      time="2018-08-09T11:55:41Z" level=info msg="starting couchbaseclusters controller"
      E0809 11:55:41.358298       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"
      E0809 11:55:42.361999       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"
      E0809 11:55:43.363888       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"
      E0809 11:55:44.365805       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"
      E0809 11:55:45.367606       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"
      E0809 11:55:46.369591       1 reflector.go:205] github.com/couchbase/couchbase-operator/vendor/github.com/coreos/operator-sdk/pkg/sdk/informer/informer.go:80: Failed to list *unstructured.Unstructured: couchbaseclusters.couchbase.database.couchbase.com is forbidden: User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in the namespace "default": User "system:serviceaccount:default:couchbase-operator" cannot list couchbaseclusters.couchbase.database.couchbase.com in project "default"

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          I saw this issue when using docker images 1.0.0-385. After switching to 1.0.0-386, this issue is not observed. So closing this ticket.

          ashwin.govindarajulu Ashwin Govindarajulu added a comment - I saw this issue when using docker images 1.0.0-385. After switching to 1.0.0-386, this issue is not observed. So closing this ticket.
          simon.murray Simon Murray added a comment -

          I guess the bug here is that the test code run against the crd & binary are not from the same source tree.

          simon.murray Simon Murray added a comment - I guess the bug here is that the test code run against the crd & binary are not from the same source tree.
          simon.murray Simon Murray added a comment -

          And if you look at the CRD you can see that this is still old, whereas the role has been updated

          metadata:
            creationTimestamp: 2018-08-09T11:30:40Z
            generation: 1
            name: couchbaseclusters.couchbase.database.couchbase.com
            resourceVersion: "1007"
            selfLink: /apis/apiextensions.k8s.io/v1beta1/customresourcedefinitions/couchbaseclusters.couchbase.database.couchbase.com
            uid: a4c60cd3-9bc7-11e8-99b8-bacf8e15f9bf
          spec:
            group: couchbase.database.couchbase.com <===========
          

          simon.murray Simon Murray added a comment - And if you look at the CRD you can see that this is still old, whereas the role has been updated metadata:   creationTimestamp: 2018-08-09T11:30:40Z   generation: 1   name: couchbaseclusters.couchbase.database.couchbase.com   resourceVersion: "1007"   selfLink: /apis/apiextensions.k8s.io/v1beta1/customresourcedefinitions/couchbaseclusters.couchbase.database.couchbase.com   uid: a4c60cd3-9bc7-11e8-99b8-bacf8e15f9bf spec:   group: couchbase.database.couchbase.com <===========
          simon.murray Simon Murray added a comment -

          If you look at the info file you can see

          metadata:
            creationTimestamp: 2018-08-09T11:30:29Z
            name: couchbase-operator
            resourceVersion: "960"
            selfLink: /apis/rbac.authorization.k8s.io/v1/clusterroles/couchbase-operator
            uid: 9e3eadcb-9bc7-11e8-99b8-bacf8e15f9bf
          rules:
          - apiGroups:
            - couchbase.com   <=========
            resources:
            - couchbaseclusters
          

          simon.murray Simon Murray added a comment - If you look at the info file you can see metadata:   creationTimestamp: 2018-08-09T11:30:29Z   name: couchbase-operator   resourceVersion: "960"   selfLink: /apis/rbac.authorization.k8s.io/v1/clusterroles/couchbase-operator   uid: 9e3eadcb-9bc7-11e8-99b8-bacf8e15f9bf rules: - apiGroups:   - couchbase.com <=========   resources:   - couchbaseclusters
          simon.murray Simon Murray added a comment -

          I'm guessing you build is old and still refers to "couchbase.database.couchbase.com" while the tests (e.g. roles and crd) refer to "couchbase.com".  Basically use a newer build and this should go away.

          I manually tested the new group name works, there are no references to the old group name, and that e2e testing also works.

          simon.murray Simon Murray added a comment - I'm guessing you build is old and still refers to "couchbase.database.couchbase.com" while the tests (e.g. roles and crd) refer to "couchbase.com".  Basically use a newer build and this should go away. I manually tested the new group name works, there are no references to the old group name, and that e2e testing also works.

          People

            ashwin.govindarajulu Ashwin Govindarajulu
            ashwin.govindarajulu Ashwin Govindarajulu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty