Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-176

pillow fight tool not working on Openshift AWS environment

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 0.7.0
    • 0.7.0
    • operator
    • None

    Description

      I am trying the Couchbase Deployment Tutorial using the documentation https://github.com/couchbase/couchbase-operator/blob/master/docs/user/demo.md and facing the following issues:

      Followed all the steps listed before this step and then started the pillow fight job:

      kubectl create -f https://packages.couchbase.com/kubernetes/beta/pillowfight-data-loader.yaml job "pillowfight" created

      The jobs is created successfully:

      [root@ip-172-31-17-218 couchbase-cli]# kubectl get jobs
      NAME           DESIRED   SUCCESSFUL   AGE
      collect-info   1         0            5m
      create-user    1         0            16m
      pillowfight    1         0            3m

      However kubectl get jobs shows the status as Container Creating always:

      [root@ip-172-31-17-218 couchbase-cli]# kubectl get pods
      NAME                                  READY     STATUS              RESTARTS   AGE
      cb-example-0000                       1/1       Running             0          1h
      cb-example-0001                       1/1       Running             0          1h
      cb-example-0002                       1/1       Running             0          1h
      collect-info-zlb4w                    1/1       Running             0          3s
      couchbase-operator-1917615544-w8ksd   1/1       Running             0          1h
      create-user-dlx8p                     0/1       ContainerCreating   0          2s
      pillowfight-vtlv5                     0/1       ContainerCreating   0          2s

      No documents seem to be added in the default bucket. Checked the Administration console.

      [root@ip-172-31-17-218 couchbase-cli]# kubectl describe pod pillowfight-prh22
      Name:        pillowfight-prh22
      Namespace:    myproject
      Node:        ip-172-31-29-178.us-west-1.compute.internal/172.31.29.178
      Start Time:    Sat, 03 Feb 2018 18:24:59 +0000
      Labels:        controller-uid=e490748a-090e-11e8-b9ef-02e60b2e7714
              job-name=pillowfight
      Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"Job","namespace":"myproject","name":"pillowfight","uid":"e490748a-090e-11e8-b9ef-02e60b2e7714","apiVersion...
              openshift.io/scc=anyuid
      Status:        Failed
      IP:        10.129.0.225
      Created By:    Job/pillowfight
      Controlled By:    Job/pillowfight
      Containers:
        pillowfight:
          Container ID:    docker://72e7fb26e70970306828a41e32689a0a388d92a8aef9e2552df8f37c2140ed13
          Image:        sequoiatools/pillowfight
          Image ID:        docker-pullable://docker.io/sequoiatools/pillowfight@sha256:1bb500cbcb5c79a138c6b652c855eea6c740d2f9dfcc68ba3bd975b3f2f8aa68
          Port:        <none>
          Command:
            cbc-pillowfight
            -U
            couchbase://cb-example-0000.cb-example.default.svc/default?select_bucket=true
            -I
            10000
            -B
            1000
            -c
            10
            -t
            1
            -P
            password
          State:        Terminated
            Reason:        Error
            Exit Code:    1
            Started:        Sat, 03 Feb 2018 18:25:03 +0000
            Finished:        Sat, 03 Feb 2018 18:25:03 +0000
          Ready:        False
          Restart Count:    0
          Environment:    <none>
          Mounts:
            /var/run/secrets/kubernetes.io/serviceaccount from default-token-jgqb4 (ro)
      Conditions:
        Type        Status
        Initialized     True
        Ready     False
        PodScheduled     True
      Volumes:
        default-token-jgqb4:
          Type:    Secret (a volume populated by a Secret)
          SecretName:    default-token-jgqb4
          Optional:    false
      QoS Class:    BestEffort
      Node-Selectors:    <none>
      Tolerations:    <none>
      Events:
        FirstSeen    LastSeen    Count    From                            SubObjectPath            Type        Reason            Message
        ---------    --------    -----    ----                            -------------            --------    ------            -------
        10s        10s        1    default-scheduler                        Normal        Scheduled        Successfully assigned pillowfight-prh22 to ip-172-31-29-178.us-west-1.compute.internal
        10s        10s        1    kubelet, ip-172-31-29-178.us-west-1.compute.internal        Normal        SuccessfulMountVolume    MountVolume.SetUp succeeded for volume "default-token-jgqb4"
        8s        8s        1    kubelet, ip-172-31-29-178.us-west-1.compute.internal    spec.containers{pillowfight}    Normal        Pulling            pulling image "sequoiatools/pillowfight"
        7s        7s        1    kubelet, ip-172-31-29-178.us-west-1.compute.internal    spec.containers{pillowfight}    Normal        Pulled            Successfully pulled image "sequoiatools/pillowfight"
        7s        7s        1    kubelet, ip-172-31-29-178.us-west-1.compute.internal    spec.containers{pillowfight}    Normal        Created            Created container
        6s        6s        1    kubelet, ip-172-31-29-178.us-west-1.compute.internal    spec.containers{pillowfight}    Normal        Started            Started container

      [root@ip-172-31-17-218 couchbase-cli]# kubectl describe pod create-user-g22rd
      Name:        create-user-g22rd
      Namespace:    myproject
      Node:        ip-172-31-17-231.us-west-1.compute.internal/172.31.17.231
      Start Time:    Sat, 03 Feb 2018 18:25:39 +0000
      Labels:        controller-uid=06e07f5b-090d-11e8-b9ef-02e60b2e7714
              job-name=create-user
      Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"Job","namespace":"myproject","name":"create-user","uid":"06e07f5b-090d-11e8-b9ef-02e60b2e7714","apiVersion...
              openshift.io/scc=anyuid
      Status:        Failed
      IP:        10.131.0.241
      Created By:    Job/create-user
      Controlled By:    Job/create-user
      Containers:
        couchbase-cli:
          Container ID:    docker://926fed6bde78021d961f69b73c94102438d6f60d223ee23e9580a70877ff285d
          Image:        sequoiatools/couchbase-cli
          Image ID:        docker-pullable://docker.io/sequoiatools/couchbase-cli@sha256:113aba533572de856f8925c106d5f2efb0380517087c3dba1933308f0a5de862
          Port:        <none>
          Command:
            /bin/sh
            -c
            /couchbase-cli-secure user-manage -c cb-example-0000.cb-example.default.svc -u {auth.admin.username} -p {auth.admin.password} --rbac-username {auth.users.default_user} --rbac-password {auth.users.default_password} --roles admin --auth-domain local --set
          State:        Terminated
            Reason:        Error
            Exit Code:    1
            Started:        Sat, 03 Feb 2018 18:25:42 +0000
            Finished:        Sat, 03 Feb 2018 18:25:43 +0000
          Ready:        False
          Restart Count:    0
          Environment:    <none>
          Mounts:
            /auth/admin from cb-admin (rw)
            /auth/users from cb-users (rw)
            /var/run/secrets/kubernetes.io/serviceaccount from default-token-jgqb4 (ro)
      Conditions:
        Type        Status
        Initialized     True
        Ready     False
        PodScheduled     True
      Volumes:
        cb-admin:
          Type:    Secret (a volume populated by a Secret)
          SecretName:    cb-example-auth
          Optional:    false
        cb-users:
          Type:    Secret (a volume populated by a Secret)
          SecretName:    cb-user-auth
          Optional:    false
        default-token-jgqb4:
          Type:    Secret (a volume populated by a Secret)
          SecretName:    default-token-jgqb4
          Optional:    false
      QoS Class:    BestEffort
      Node-Selectors:    <none>
      Tolerations:    <none>
      Events:
        FirstSeen    LastSeen    Count    From                            SubObjectPath            Type        Reason            Message
        ---------    --------    -----    ----                            -------------            --------    ------            -------
        12s        12s        1    default-scheduler                        Normal        Scheduled        Successfully assigned create-user-g22rd to ip-172-31-17-231.us-west-1.compute.internal
        12s        12s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal        Normal        SuccessfulMountVolume    MountVolume.SetUp succeeded for volume "cb-users"
        12s        12s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal        Normal        SuccessfulMountVolume    MountVolume.SetUp succeeded for volume "default-token-jgqb4"
        12s        12s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal        Normal        SuccessfulMountVolume    MountVolume.SetUp succeeded for volume "cb-admin"
        10s        10s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal    spec.containers{couchbase-cli}    Normal        Pulled            Container image "sequoiatools/couchbase-cli" already present on machine
        9s        9s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal    spec.containers{couchbase-cli}    Normal        Created            Created container
        9s        9s        1    kubelet, ip-172-31-17-231.us-west-1.compute.internal    spec.containers{couchbase-cli}    Normal        Started            Started container
      [root@ip-172-31-17-218 couchbase-cli]#

      Is this an expected behavior? What am i missing? Is there any setting specific to the sequioa tools?

      Attachments

        For Gerrit Dashboard: K8S-176
        # Subject Branch Project Status CR V

        Activity

          People

            tommie Tommie McAfee (Inactive)
            sindhura.palakodety Sindhura Palakodety (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty