Require way to do OpenShift and Docker Hub testing without publishing public images on RHCC or Docker Hub
Description
Environment
Release Notes Description
Activity
Arunkumar Senthilnathan April 10, 2020 at 4:43 PM
oops thanks for marking it private !
Arunkumar Senthilnathan April 9, 2020 at 12:17 AMEdited
TL;DR: we can run openshift regression now without publishing images to RHCC
Figured out a way to run openshift regression with internal rhel images - operator and admission-controller already rhel images in docker hub staging repos - server and sync-gateway rhel images were missing though - thanks to we have 6.0.4 and 6.5.0 server rhel images and sgw 2.7.0 rhel image in the respective docker hub staging repos now - with that I was able to run tests on our openshift regression cluster:
test_config:
results:
time="2020-04-08T16:39:34-07:00" level=info msg="E2E setup successfully"
time="2020-04-08T16:39:34-07:00" level=info msg="Starting suite TestSanity"
— PASS: TestOperator (462.35s)
=== RUN TestOperator/TestFullIncremental
— PASS: TestOperator/TestFullIncremental (415.05s)
crd_util.go:26: creating couchbase cluster: test-couchbase-nk27s
test_util.go:35: Suite Test Results:
test_util.go:64: 1: TestFullIncremental...PASS
test_util.go:106:
Pass: 1.000000
Fail: 0.000000
Pass Rate: 100.000000
PASS
time="2020-04-08T16:17:02-07:00" level=info msg="Starting suite TestSanity"
— PASS: TestOperator (555.77s)
=== RUN TestOperator/TestCreateCluster
— PASS: TestOperator/TestCreateCluster (490.31s)
crd_util.go:26: creating couchbase cluster: test-couchbase-f2l26
test_util.go:35: Suite Test Results:
test_util.go:64: 1: TestCreateCluster...PASS
test_util.go:106:
Pass: 1.000000
Fail: 0.000000
Pass Rate: 100.000000
Filed so that we have rhel images for server and sgw pushed regularly for future releases
Only thing left to figure out now is daemonset for openshift to do package validation
Arunkumar Senthilnathan April 7, 2020 at 11:36 PM
and I worked on EKS cluster today and got it to working - now we know how we can leverage this for package validation on kubernetes clusters - we don't need any changes in code to run regression for kubernetes clusters as we pull images from the internal docker hub repos by creating a docker secret in the test framework
Next step is to figure out how to get the DS working on openshift for package validation - for openshift regression, we need the DS to work with the test framework so that we can run regression against internal builds before publishing
Simon Murray April 7, 2020 at 8:39 AM
Openshift doesn't use docker, it uses CRI-O (I think), you'll need to work out what the analogous commands are, shell into a pod running without filesystem containerization and have a play about.
Arunkumar Senthilnathan April 7, 2020 at 12:28 AM
and I tried the given yaml on the regression OC cluster - the pods crashed and exited - then we tried a basic docker command on the same cluster but it errored out saying "Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?" - we switched to our regression EKS cluster but still no luck - when we login to the EKS cluster worker nodes as ec2-user, we are able to execute docker commands without any issues - but with daemonset, there seems to be an issue - another thing to note here is that we do not have direct ssh access to our OC cluster nodes (deployed with terraform scripts from redhat)
Started by discussion on . We already create Red Hat-based images for every Operator build. However we are being told that it is impossible to do any testing in OpenShift without publishing the images onto the Red Hat Container Catalog (RHCC). Not only is this a potentially significant waste of time for us (RHCC is a pain in the neck to deal with), but it means that we are constantly releasing our internal and untested content onto the open internet where anyone can download it.
I cannot believe that OpenShift has no concept of "testing images". If they do, then we need to start using it. If they do not, then we need to use our contacts inside Red Hat and inform them we cannot support their environment until they do.