Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-612

Pod Creation Failure Should Report The Phase That Failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • 1.1.0
    • None
    • operator
    • None
    • Azure AKS

    Description

      Cannot setup TLS with couchbase operator

      time="2018-10-02T03:43:29Z" level=info msg="Setting up secure client for operator communication with the cluster" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:43:29Z" level=info msg="Cluster does not exist so the operator is attempting to create it" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:43:29Z" level=info msg="Creating headless service for data nodes" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:43:29Z" level=info msg="Creating NodePort UI service (cb-op-aks-cluster-mini-ui) for data nodes" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:43:30Z" level=info msg="Creating a pod (cb-op-aks-cluster-mini-0000) running Couchbase enterprise-5.5.1" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:47:41Z" level=info msg="deleted pod (cb-op-aks-cluster-mini-0000)" cluster-name=cb-op-aks-cluster-mini module=cluster

      time="2018-10-02T03:47:41Z" level=error msg="Cluster setup failed: context deadline exceeded" cluster-name=cb-op-aks-cluster-mini module=cluster
      time="2018-10-02T03:47:41Z" level=warning msg="Fail to handle event: ignore failed cluster (cb-op-aks-cluster-mini). Please delete its CR"

       pods gets deleted when operator gives up on the cluster

      pod stays in init state for long time

      $ kubectl get pods
      NAME READY STATUS RESTARTS AGE cb-op-aks-cluster-mini-0000 0/1 Init:0/1 0 6s
      couchbase-operator-6cb7687498-f8wb9 1/1 Running 0 1h
      $ kubectl logs -f cb-op-aks-cluster-mini-0000
      Error from server (BadRequest): container "couchbase-server" in pod "cb-op-aks-cluster-mini-0000" is waiting to start: PodInitializing

       

      $ kubectl logs -f cb-op-aks-cluster-mini-0000
      Starting Couchbase Server – Web UI available at http://<ip>:8091
      and logs available in /opt/couchbase/var/lib/couchbase/logs
      chown: changing ownership of 'var/lib/couchbase/inbox/..data': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox/pkey.key': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox/chain.pem': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox/..2018_10_02_03_43_47.616069532/pkey.key': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox/..2018_10_02_03_43_47.616069532/chain.pem': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox/..2018_10_02_03_43_47.616069532': Read-only file system
      chown: changing ownership of 'var/lib/couchbase/inbox': Read-only file system

      $ kubectl logs -f cb-op-aks-cluster-mini-0000
      Error from server (NotFound): pods "cb-op-aks-cluster-mini-0000" not found

      Not sure if this is related to the platform AKS

       

       

      Attachments

        1. ca.crt
          1 kB
        2. chain.pem
          5 kB
        3. pkey.key
          2 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            daniel.ma Daniel Ma (Inactive)
            ram.dhakne Ram Dhakne (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty