Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-1171

Rebalance exited with reason {badmatch,failed} ns_orchestrator 000

    XMLWordPrintable

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: User Error
    • None
    • None
    • couchbase-server

    Description

      Hi, 

      I've configured couchbase (6.0.2) on kuberenetes two node cluster, after executing kubectl create -f couchbase-cluster.yaml , rebalancing is not happening.
      rebalance failed with below error

      Rebalance exited with reason {badmatch,failed}ns_orchestrator 000,

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          simon.murray Simon Murray added a comment -

          Oh I tell a lie, when it's not exposed the default value is "".  Your CNI plugin appears to again be not working.  Do a kubectl get svc cb-example-ui -o yaml and see what it shows as its node port...

          simon.murray Simon Murray added a comment - Oh I tell a lie, when it's not exposed the default value is "".  Your CNI plugin appears to again be not working.  Do a kubectl get svc cb-example-ui -o yaml and see what it shows as its node port...
          gunasekhar Gunasekhar added a comment -

          Simon Murray, Please check yaml content below

           

          [root@k8-crdl-master scripts]# kubectl get svc cb-example-ui -o yaml
          apiVersion: v1
          kind: Service
          metadata:
          annotations:
          operator.couchbase.com/version: 1.2.1
          service.alpha.kubernetes.io/tolerate-unready-endpoints: "true"
          creationTimestamp: "2019-11-20T11:21:20Z"
          labels:
          app: couchbase
          couchbase_cluster: cb-example
          name: cb-example-ui
          namespace: default
          ownerReferences:

          • apiVersion: couchbase.com/v1
            controller: true
            kind: CouchbaseCluster
            name: cb-example
            uid: 13b2b6dd-4129-4244-bc0a-1331649d34d1
            resourceVersion: "5976"
            selfLink: /api/v1/namespaces/default/services/cb-example-ui
            uid: 0cf8fb28-6eb4-4950-8ed3-156b22bcfe34
            spec:
            clusterIP: 10.100.34.45
            ports:
          • name: couchbase-ui
            port: 8091
            protocol: TCP
            targetPort: 8091
          • name: couchbase-ui-tls
            port: 18091
            protocol: TCP
            targetPort: 18091
            selector:
            app: couchbase
            couchbase_cluster: cb-example
            couchbase_service_data: enabled
            sessionAffinity: ClientIP
            sessionAffinityConfig:
            clientIP:
            timeoutSeconds: 10800
            type: ClusterIP
            status:
            loadBalancer: {}
          gunasekhar Gunasekhar added a comment - Simon Murray , Please check yaml content below   [root@k8-crdl-master scripts] # kubectl get svc cb-example-ui -o yaml apiVersion: v1 kind: Service metadata: annotations: operator.couchbase.com/version: 1.2.1 service.alpha.kubernetes.io/tolerate-unready-endpoints: "true" creationTimestamp: "2019-11-20T11:21:20Z" labels: app: couchbase couchbase_cluster: cb-example name: cb-example-ui namespace: default ownerReferences: apiVersion: couchbase.com/v1 controller: true kind: CouchbaseCluster name: cb-example uid: 13b2b6dd-4129-4244-bc0a-1331649d34d1 resourceVersion: "5976" selfLink: /api/v1/namespaces/default/services/cb-example-ui uid: 0cf8fb28-6eb4-4950-8ed3-156b22bcfe34 spec: clusterIP: 10.100.34.45 ports: name: couchbase-ui port: 8091 protocol: TCP targetPort: 8091 name: couchbase-ui-tls port: 18091 protocol: TCP targetPort: 18091 selector: app: couchbase couchbase_cluster: cb-example couchbase_service_data: enabled sessionAffinity: ClientIP sessionAffinityConfig: clientIP: timeoutSeconds: 10800 type: ClusterIP status: loadBalancer: {}
          simon.murray Simon Murray added a comment -

          Oh I see, that would have raised an error on all other platforms Again because you aren't running the dynamic admission controller you haven't got working defaults added to the adminConsoleServiceType, e.g. NodePort https://docs.couchbase.com/operator/1.2/couchbase-cluster-config.html#adminconsoleservicetype

          simon.murray Simon Murray added a comment - Oh I see, that would have raised an error on all other platforms Again because you aren't running the dynamic admission controller you haven't got working defaults added to the adminConsoleServiceType, e.g. NodePort https://docs.couchbase.com/operator/1.2/couchbase-cluster-config.html#adminconsoleservicetype
          gunasekhar Gunasekhar added a comment -

          Thanks Simon Murray,

          I'm able to access GUI after doing changes to couchbase-cluster.yaml file.

          [root@k8-crdl-master scripts]# kubectl get svc
          NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
          cb-example ClusterIP None <none> 8091/TCP,18091/TCP 4h40m
          cb-example-srv ClusterIP None <none> 11210/TCP,11207/TCP 4h40m
          cb-example-ui NodePort 10.100.34.45 <none> 8091:31502/TCP,18091:32709/TCP 4h40m
          couchbase-operator-admission ClusterIP 10.100.83.207 <none> 443/TCP 5h9m
          kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 5h29m

          gunasekhar Gunasekhar added a comment - Thanks Simon Murray , I'm able to access GUI after doing changes to couchbase-cluster.yaml file. [root@k8-crdl-master scripts] # kubectl get svc NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE cb-example ClusterIP None <none> 8091/TCP,18091/TCP 4h40m cb-example-srv ClusterIP None <none> 11210/TCP,11207/TCP 4h40m cb-example-ui NodePort 10.100.34.45 <none> 8091:31502 /TCP,18091:32709/TCP 4h40m couchbase-operator-admission ClusterIP 10.100.83.207 <none> 443/TCP 5h9m kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 5h29m
          simon.murray Simon Murray added a comment -

          Nothing found with the product so closing.

          In future until we have determined there is a new feature required or an existing bug the forums (https://forums.couchbase.com/) is the most appropriate place for these queries, or if you have an enterprise account raise an issue via the customer portal.

          Thanks!

          simon.murray Simon Murray added a comment - Nothing found with the product so closing. In future until we have determined there is a new feature required or an existing bug the forums ( https://forums.couchbase.com/) is the most appropriate place for these queries, or if you have an enterprise account raise an issue via the customer portal. Thanks!

          People

            simon.murray Simon Murray
            gunasekhar Gunasekhar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty