[INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building cbas-docker-test 1.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-antrun-plugin:1.8:run (check-pom-packaging) @ cbas-docker-test --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (ensure-no-tests-for-pom-packaging) @ cbas-docker-test --- [INFO] Skipping Rule Enforcement. [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ cbas-docker-test --- [INFO] [INFO] --- maven-checkstyle-plugin:3.0.0:check (verify-style) @ cbas-docker-test --- [INFO] [INFO] --- formatter-maven-plugin:2.0.1:format (default) @ cbas-docker-test --- [INFO] Formatting is skipped [INFO] [INFO] --- impsort-maven-plugin:1.2.0:sort (default) @ cbas-docker-test --- [INFO] Total Files Processed: 33 in 00:00.133 [INFO] Already Sorted: 33 [INFO] Needed Sorting: 0 [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ cbas-docker-test --- [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ cbas-docker-test --- [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ cbas-docker-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ cbas-docker-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-antrun-plugin:1.8:run (default) @ cbas-docker-test --- [INFO] Executing tasks main: [echo] Creating docker-image.properties file [mkdir] Created dir: /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/test-classes [propertyfile] Creating new property file: /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/test-classes/docker-image.properties [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ cbas-docker-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- docker-maven-plugin:1.0.0-SNAPSHOT:docker-prune (prune) @ cbas-docker-test --- [INFO] Removing docker objects created before: 2020-12-30T07:32:34.84882-08:00[America/Los_Angeles] (now()-PT336H) [WARNING] Cannot obtain created timestamp for network: 6mruvmtvsau6m3lmrzyzgdi0l. Skipping [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ cbas-docker-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 33 source files to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/test-classes [WARNING] /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/test/java/com/couchbase/analytics/test/docker/DockerTestBase.java:[268,16] closeQuietly(java.io.Closeable) in org.apache.commons.io.IOUtils has been deprecated [WARNING] /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/test/java/com/couchbase/analytics/test/docker/DockerTestBase.java:[489,31] withBinds(java.util.List) in com.github.dockerjava.api.command.CreateContainerCmd has been deprecated [WARNING] /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/test/java/com/couchbase/analytics/test/docker/DockerTestBase.java:[491,31] withNetworkMode(java.lang.String) in com.github.dockerjava.api.command.CreateContainerCmd has been deprecated [WARNING] /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/test/java/com/couchbase/analytics/test/docker/DockerTestBase.java:[494,31] withPortBindings(java.util.List) in com.github.dockerjava.api.command.CreateContainerCmd has been deprecated [WARNING] /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/src/test/java/com/couchbase/analytics/test/docker/DockerTestBase.java:[496,31] withPublishAllPorts(java.lang.Boolean) in com.github.dockerjava.api.command.CreateContainerCmd has been deprecated [INFO] [INFO] --- maven-dependency-plugin:3.1.2:analyze-only (default) @ cbas-docker-test --- [INFO] No dependency problems found [INFO] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-docker-resources) @ cbas-docker-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 0 resource [INFO] [INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @ cbas-docker-test --- [JENKINS] Recording test results [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ cbas-docker-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/cbas-docker-test-1.0.0-SNAPSHOT.jar [INFO] [INFO] --- maven-jar-plugin:3.0.2:test-jar (default) @ cbas-docker-test --- [INFO] Building jar: /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/cbas-docker-test-1.0.0-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-site-plugin:3.7.1:attach-descriptor (attach-descriptor) @ cbas-docker-test --- [INFO] Skipping because packaging 'jar' is not pom. [INFO] [INFO] --- maven-failsafe-plugin:2.21.0:integration-test (default) @ cbas-docker-test --- [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running com.couchbase.analytics.test.docker.DockerClusterBasicITD 2021-01-13 07:32:39,164 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:32:39.240-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:32:39.256-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:32:39.257-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:32:39.264-08:00 WARN TestMethodTracer [main] ### twoNodeClusterDataAndAnalytics START 2021-01-13T07:32:40.211-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-0ac94b0e-2898-4465-a02e-a6c3d49f8198) 2021-01-13T07:32:40.328-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-0ac94b0e-2898-4465-a02e-a6c3d49f8198, id = d62ec01d4b20a92644350e40c7831000a8d665cae9e9b9f17f040f28bfd7b859 } 2021-01-13T07:32:40.329-08:00 INFO DockerClusterBasicITD [main] Creating node #1 ... 2021-01-13T07:32:40.331-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:32:40.652-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:32:40.659-08:00 INFO DockerTestBase [main+] >> 6a5697faee43: Pulling fs layer 2021-01-13T07:32:40.660-08:00 INFO DockerTestBase [main+] >> ba13d3bc422b: Pulling fs layer 2021-01-13T07:32:40.661-08:00 INFO DockerTestBase [main+] >> a254829d9e55: Pulling fs layer 2021-01-13T07:32:40.662-08:00 INFO DockerTestBase [main+] >> d43490550b70: Pulling fs layer 2021-01-13T07:32:40.662-08:00 INFO DockerTestBase [main+] >> 7b73e3478ccc: Pulling fs layer 2021-01-13T07:32:40.663-08:00 INFO DockerTestBase [main+] >> bf21118b65ca: Pulling fs layer 2021-01-13T07:32:40.664-08:00 INFO DockerTestBase [main+] >> 710d5d0ac3cb: Pulling fs layer 2021-01-13T07:32:40.665-08:00 INFO DockerTestBase [main+] >> 6f75abca0c92: Pulling fs layer 2021-01-13T07:32:40.666-08:00 INFO DockerTestBase [main+] >> c5e9d26cb3f4: Pulling fs layer 2021-01-13T07:32:40.667-08:00 INFO DockerTestBase [main+] >> 8d5465013654: Pulling fs layer 2021-01-13T07:32:40.667-08:00 INFO DockerTestBase [main+] >> f4e3206a78b7: Pulling fs layer 2021-01-13T07:32:40.668-08:00 INFO DockerTestBase [main+] >> 04533e210465: Pulling fs layer 2021-01-13T07:32:40.669-08:00 INFO DockerTestBase [main+] >> 9d1545c482e9: Pulling fs layer 2021-01-13T07:32:40.669-08:00 INFO DockerTestBase [main+] >> 8efe4c83e78f: Pulling fs layer 2021-01-13T07:32:40.669-08:00 INFO DockerTestBase [main+] >> d43490550b70: Waiting 2021-01-13T07:32:40.673-08:00 INFO DockerTestBase [main+] >> 7b73e3478ccc: Waiting 2021-01-13T07:32:40.673-08:00 INFO DockerTestBase [main+] >> bf21118b65ca: Waiting 2021-01-13T07:32:40.673-08:00 INFO DockerTestBase [main+] >> 710d5d0ac3cb: Waiting 2021-01-13T07:32:40.674-08:00 INFO DockerTestBase [main+] >> 6f75abca0c92: Waiting 2021-01-13T07:32:40.676-08:00 INFO DockerTestBase [main+] >> c5e9d26cb3f4: Waiting 2021-01-13T07:32:40.676-08:00 INFO DockerTestBase [main+] >> 8d5465013654: Waiting 2021-01-13T07:32:40.676-08:00 INFO DockerTestBase [main+] >> f4e3206a78b7: Waiting 2021-01-13T07:32:40.677-08:00 INFO DockerTestBase [main+] >> 04533e210465: Waiting 2021-01-13T07:32:40.677-08:00 INFO DockerTestBase [main+] >> 9d1545c482e9: Waiting 2021-01-13T07:32:40.677-08:00 INFO DockerTestBase [main+] >> 8efe4c83e78f: Waiting 2021-01-13T07:32:40.873-08:00 INFO DockerTestBase [main+] >> ba13d3bc422b: Verifying Checksum 2021-01-13T07:32:40.874-08:00 INFO DockerTestBase [main+] >> ba13d3bc422b: Download complete 2021-01-13T07:32:41.001-08:00 INFO DockerTestBase [main+] >> a254829d9e55: Verifying Checksum 2021-01-13T07:32:41.002-08:00 INFO DockerTestBase [main+] >> a254829d9e55: Download complete 2021-01-13T07:32:41.127-08:00 INFO DockerTestBase [main+] >> 7b73e3478ccc: Verifying Checksum 2021-01-13T07:32:41.128-08:00 INFO DockerTestBase [main+] >> 7b73e3478ccc: Download complete 2021-01-13T07:32:41.227-08:00 INFO DockerTestBase [main+] >> bf21118b65ca: Verifying Checksum 2021-01-13T07:32:41.227-08:00 INFO DockerTestBase [main+] >> bf21118b65ca: Download complete 2021-01-13T07:32:41.332-08:00 INFO DockerTestBase [main+] >> d43490550b70: Verifying Checksum 2021-01-13T07:32:41.333-08:00 INFO DockerTestBase [main+] >> d43490550b70: Download complete 2021-01-13T07:32:41.381-08:00 INFO DockerTestBase [main+] >> 6f75abca0c92: Verifying Checksum 2021-01-13T07:32:41.381-08:00 INFO DockerTestBase [main+] >> 6f75abca0c92: Download complete 2021-01-13T07:32:41.484-08:00 INFO DockerTestBase [main+] >> c5e9d26cb3f4: Download complete 2021-01-13T07:32:41.536-08:00 INFO DockerTestBase [main+] >> 8d5465013654: Verifying Checksum 2021-01-13T07:32:41.537-08:00 INFO DockerTestBase [main+] >> 8d5465013654: Download complete 2021-01-13T07:32:41.648-08:00 INFO DockerTestBase [main+] >> f4e3206a78b7: Verifying Checksum 2021-01-13T07:32:41.649-08:00 INFO DockerTestBase [main+] >> f4e3206a78b7: Download complete 2021-01-13T07:32:41.703-08:00 INFO DockerTestBase [main+] >> 04533e210465: Verifying Checksum 2021-01-13T07:32:41.704-08:00 INFO DockerTestBase [main+] >> 04533e210465: Download complete 2021-01-13T07:32:42.153-08:00 INFO DockerTestBase [main+] >> 9d1545c482e9: Verifying Checksum 2021-01-13T07:32:42.154-08:00 INFO DockerTestBase [main+] >> 9d1545c482e9: Download complete 2021-01-13T07:32:42.200-08:00 INFO DockerTestBase [main+] >> 8efe4c83e78f: Verifying Checksum 2021-01-13T07:32:42.201-08:00 INFO DockerTestBase [main+] >> 8efe4c83e78f: Download complete 2021-01-13T07:33:09.583-08:00 INFO DockerTestBase [main+] >> 6a5697faee43: Verifying Checksum 2021-01-13T07:33:09.584-08:00 INFO DockerTestBase [main+] >> 6a5697faee43: Download complete 2021-01-13T07:33:11.010-08:00 INFO DockerTestBase [main+] >> 6a5697faee43: Pull complete 2021-01-13T07:33:11.101-08:00 INFO DockerTestBase [main+] >> ba13d3bc422b: Pull complete 2021-01-13T07:33:11.224-08:00 INFO DockerTestBase [main+] >> a254829d9e55: Pull complete 2021-01-13T07:33:11.790-08:00 INFO DockerTestBase [main+] >> d43490550b70: Pull complete 2021-01-13T07:33:11.884-08:00 INFO DockerTestBase [main+] >> 7b73e3478ccc: Pull complete 2021-01-13T07:33:11.980-08:00 INFO DockerTestBase [main+] >> bf21118b65ca: Pull complete 2021-01-13T07:35:18.845-08:00 INFO DockerTestBase [main+] >> 710d5d0ac3cb: Verifying Checksum 2021-01-13T07:35:18.845-08:00 INFO DockerTestBase [main+] >> 710d5d0ac3cb: Download complete 2021-01-13T07:35:35.903-08:00 INFO DockerTestBase [main+] >> 710d5d0ac3cb: Pull complete 2021-01-13T07:35:36.001-08:00 INFO DockerTestBase [main+] >> 6f75abca0c92: Pull complete 2021-01-13T07:35:36.097-08:00 INFO DockerTestBase [main+] >> c5e9d26cb3f4: Pull complete 2021-01-13T07:35:36.205-08:00 INFO DockerTestBase [main+] >> 8d5465013654: Pull complete 2021-01-13T07:35:36.322-08:00 INFO DockerTestBase [main+] >> f4e3206a78b7: Pull complete 2021-01-13T07:35:36.421-08:00 INFO DockerTestBase [main+] >> 04533e210465: Pull complete 2021-01-13T07:35:36.516-08:00 INFO DockerTestBase [main+] >> 9d1545c482e9: Pull complete 2021-01-13T07:35:36.612-08:00 INFO DockerTestBase [main+] >> 8efe4c83e78f: Pull complete 2021-01-13T07:35:36.618-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:35:36.621-08:00 INFO DockerTestBase [main+] >> Status: Downloaded newer image for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:35:36.624-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:35:36.627-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/twoNodeClusterDataAndAnalytics/0001_n1_thisbuild, network = { name = cbas-docker-test-0001-0ac94b0e-2898-4465-a02e-a6c3d49f8198, id = d62ec01d4b20a92644350e40c7831000a8d665cae9e9b9f17f040f28bfd7b859 }) 2021-01-13T07:35:37.693-08:00 INFO DockerTestBase [main] Container information for 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55697->192.168.176.2:8095, 172.17.0.1:55701->192.168.176.2:8091 2021-01-13T07:35:45.816-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:35:45.818-08:00 INFO DockerTestBase [main] Executing the command: docker exec 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:35:46.871-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:35:46.899-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:35:46.900-08:00 INFO DockerTestBase [main] Executing the command: docker exec 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:35:47.316-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:35:47.369-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:36:01.103-08:00 INFO DockerClusterBasicITD [main] Creating node #2 ... 2021-01-13T07:36:01.104-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/twoNodeClusterDataAndAnalytics/0002_n2_thisbuild, network = { name = cbas-docker-test-0001-0ac94b0e-2898-4465-a02e-a6c3d49f8198, id = d62ec01d4b20a92644350e40c7831000a8d665cae9e9b9f17f040f28bfd7b859 }) 2021-01-13T07:36:05.854-08:00 INFO DockerTestBase [main] Container information for 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55712->192.168.176.3:8095, 172.17.0.1:55716->192.168.176.3:8091 2021-01-13T07:36:16.921-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:36:16.921-08:00 INFO DockerTestBase [main] Executing the command: docker exec 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:36:17.596-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:36:17.643-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [DATA, ANALYTICS] 2021-01-13T07:36:17.644-08:00 INFO DockerTestBase [main] Executing the command: docker exec 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data,analytics 2021-01-13T07:36:20.664-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:36:20.699-08:00 INFO DockerClusterBasicITD [main] Rebalancing ... 2021-01-13T07:36:20.700-08:00 INFO DockerTestBase [main] Running 'rebalance' 2021-01-13T07:36:20.701-08:00 INFO DockerTestBase [main] Executing the command: docker exec 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T07:36:29.155-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:36:29.156-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:36:29.184-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:36:29.219-08:00 INFO DockerTestBase [main] Copying files from docker container 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/twoNodeClusterDataAndAnalytics/0002_n2_thisbuild 2021-01-13T07:36:29.220-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/twoNodeClusterDataAndAnalytics/0001_n1_thisbuild 2021-01-13T07:36:29.575-08:00 INFO DockerTestBase [main] Stopping docker container: 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694 2021-01-13T07:36:29.586-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 2021-01-13T07:36:30.425-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 2021-01-13T07:36:30.502-08:00 INFO DockerTestBase [main] Stopped docker container: 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694 2021-01-13T07:36:30.504-08:00 INFO DockerTestBase [main] Removing docker container: 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694 2021-01-13T07:36:30.504-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 2021-01-13T07:36:30.515-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 58f4a4fa2207c5ac9bcebd5ce0e5b3fe31d118ccb82f238cfb5cce39cb0a61c9 2021-01-13T07:36:30.515-08:00 INFO DockerTestBase [main] Removed docker container: 7b79c01b451bdc1e0df6a3e10f7dbc36edf202646c1c8e60ac903103b6b16694 2021-01-13T07:36:30.517-08:00 INFO DockerTestBase [main] Removing docker network: d62ec01d4b20a92644350e40c7831000a8d665cae9e9b9f17f040f28bfd7b859 2021-01-13T07:36:30.584-08:00 INFO DockerTestBase [main] Removed docker network: d62ec01d4b20a92644350e40c7831000a8d665cae9e9b9f17f040f28bfd7b859 2021-01-13T07:36:30.592-08:00 WARN TestMethodTracer [main] ### twoNodeClusterDataAndAnalytics SUCCEEDED 2021-01-13T07:36:30.593-08:00 WARN TestMethodTracer [main] ### verifyGMTOutputInLogs START 2021-01-13T07:36:30.640-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0002-41835e85-9ce1-49f9-9121-5cffdf8c3304) 2021-01-13T07:36:30.684-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0002-41835e85-9ce1-49f9-9121-5cffdf8c3304, id = 8cea352f68f33465ad7b1ea801cdfc71d3394f19127099ca5c141870dc5ccf78 } 2021-01-13T07:36:30.684-08:00 INFO DockerClusterBasicITD [main] Creating node ... 2021-01-13T07:36:30.685-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/verifyGMTOutputInLogs/0003_n1_thisbuild, network = { name = cbas-docker-test-0002-41835e85-9ce1-49f9-9121-5cffdf8c3304, id = 8cea352f68f33465ad7b1ea801cdfc71d3394f19127099ca5c141870dc5ccf78 }) 2021-01-13T07:36:31.438-08:00 INFO DockerTestBase [main] Container information for de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55727->192.168.176.2:8095, 172.17.0.1:55731->192.168.176.2:8091 2021-01-13T07:36:39.470-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:36:39.470-08:00 INFO DockerTestBase [main] Executing the command: docker exec de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:36:40.248-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:36:40.284-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:36:40.285-08:00 INFO DockerTestBase [main] Executing the command: docker exec de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:36:40.682-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:36:40.721-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:36:53.190-08:00 INFO DockerTestBase [main] Copying files from docker container de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.DockerClusterBasicITD/verifyGMTOutputInLogs/0003_n1_thisbuild 2021-01-13T07:36:53.395-08:00 INFO DockerTestBase [main] Stopping docker container: de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 2021-01-13T07:36:53.801-08:00 INFO DockerTestBase [main] Stopped docker container: de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 2021-01-13T07:36:53.838-08:00 INFO DockerTestBase [main] Removing docker container: de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 2021-01-13T07:36:53.868-08:00 INFO DockerTestBase [main] Removed docker container: de74f7fbe8d2aad2740cc7724ac818d98438e063eef002c87726f6e03c0f1400 2021-01-13T07:36:53.869-08:00 INFO DockerTestBase [main] Removing docker network: 8cea352f68f33465ad7b1ea801cdfc71d3394f19127099ca5c141870dc5ccf78 2021-01-13T07:36:53.943-08:00 INFO DockerTestBase [main] Removed docker network: 8cea352f68f33465ad7b1ea801cdfc71d3394f19127099ca5c141870dc5ccf78 2021-01-13T07:36:53.946-08:00 WARN TestMethodTracer [main] ### verifyGMTOutputInLogs SUCCEEDED [WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 255.867 s - in com.couchbase.analytics.test.docker.DockerClusterBasicITD [INFO] Running com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD 2021-01-13 07:36:56,054 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:36:56.160-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:36:56.178-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:36:56.178-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:36:56.187-08:00 WARN TestMethodTracer [main] ### testLoopbackPublicAddress START 2021-01-13T07:36:57.376-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-f0743017-b187-4f7f-9d4c-2d077c2a056d) 2021-01-13T07:36:57.456-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-f0743017-b187-4f7f-9d4c-2d077c2a056d, id = defd113e3939e8755772951da70013bed0ce91acc8c8cde234f846d83c6ce48b } 2021-01-13T07:36:57.461-08:00 INFO AzureBestPracticesITD [pool] Creating n1 node ... 2021-01-13T07:36:57.463-08:00 INFO AzureBestPracticesITD [pool] Creating n2 node ... 2021-01-13T07:36:57.470-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:36:57.475-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:36:57.478-08:00 INFO AzureBestPracticesITD [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/hosts.n2 to /etc/hosts 2021-01-13T07:36:57.478-08:00 INFO AzureBestPracticesITD [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/hosts.n1 to /etc/hosts 2021-01-13T07:36:57.481-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:36:57.547-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:36:57.548-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:36:57.548-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:36:57.549-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:36:57.553-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD/testLoopbackPublicAddress/0002_n1_thisbuild, network = { name = cbas-docker-test-0001-f0743017-b187-4f7f-9d4c-2d077c2a056d, id = defd113e3939e8755772951da70013bed0ce91acc8c8cde234f846d83c6ce48b }) 2021-01-13T07:36:57.553-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD/testLoopbackPublicAddress/0001_n2_thisbuild, network = { name = cbas-docker-test-0001-f0743017-b187-4f7f-9d4c-2d077c2a056d, id = defd113e3939e8755772951da70013bed0ce91acc8c8cde234f846d83c6ce48b }) 2021-01-13T07:36:58.846-08:00 INFO DockerTestBase [pool] Container information for 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55761->192.168.176.3:8091, 172.17.0.1:55754->192.168.176.3:8095 2021-01-13T07:36:58.848-08:00 INFO DockerTestBase [pool] Container information for 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55759->192.168.176.2:8091, 172.17.0.1:55751->192.168.176.2:8095 2021-01-13T07:37:07.339-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:37:07.341-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:37:08.192-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:37:08.220-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:37:08.220-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:37:09.388-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:37:09.419-08:00 INFO DockerTestBase [main] Executing the command: docker exec 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d sh -c cat /etc/hosts 2021-01-13T07:37:09.568-08:00 INFO AzureBestPracticesITD [main] hosts file: 127.0.0.1 locahost n1 n1.couchbase.host 2021-01-13T07:37:09.572-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:37:09.573-08:00 INFO DockerTestBase [main] Executing the command: docker exec 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:37:10.046-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:37:10.088-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T07:37:10.089-08:00 INFO DockerTestBase [main] Executing the command: docker exec 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:37:13.453-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:37:13.489-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T07:37:13.490-08:00 INFO DockerTestBase [main] Executing the command: docker exec 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T07:37:24.994-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:37:24.995-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:37:25.027-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:37:25.037-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:37:25.049-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:37:25.219-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55759] 2021-01-13T07:37:25.222-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:55759 2021-01-13T07:37:26.295-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55761] 2021-01-13T07:37:30.087-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:37:30.090-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:37:31.151-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 71 } 2021-01-13T07:37:31.156-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 71 } 2021-01-13T07:37:32.157-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:37:32.400-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2955 } 2021-01-13T07:37:32.400-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2955 } 2021-01-13T07:37:33.402-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:37:33.683-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:37:33.684-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:37:33.692-08:00 INFO DockerTestBase [main] Copying files from docker container 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD/testLoopbackPublicAddress/0001_n2_thisbuild 2021-01-13T07:37:33.693-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD/testLoopbackPublicAddress/0002_n1_thisbuild 2021-01-13T07:37:34.065-08:00 INFO DockerTestBase [main] Stopping docker container: 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d 2021-01-13T07:37:34.079-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d 2021-01-13T07:37:34.642-08:00 INFO DockerTestBase [main] Stopped docker container: 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d 2021-01-13T07:37:34.666-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d 2021-01-13T07:37:34.668-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d 2021-01-13T07:37:34.668-08:00 INFO DockerTestBase [main] Removing docker container: 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d 2021-01-13T07:37:34.680-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 96edcb727e23de8ff484bb31fdb1b22b2f6433ebe295c4cf36b79fd68fa2138d 2021-01-13T07:37:34.680-08:00 INFO DockerTestBase [main] Removed docker container: 9fe36aa9a7a750b5d92a8d563b822749a4f71bc6dcd3b11ae285e0a59869fb6d 2021-01-13T07:37:34.681-08:00 INFO DockerTestBase [main] Removing docker network: defd113e3939e8755772951da70013bed0ce91acc8c8cde234f846d83c6ce48b 2021-01-13T07:37:34.737-08:00 INFO DockerTestBase [main] Removed docker network: defd113e3939e8755772951da70013bed0ce91acc8c8cde234f846d83c6ce48b 2021-01-13T07:37:34.744-08:00 WARN TestMethodTracer [main] ### testLoopbackPublicAddress SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.873 s - in com.couchbase.analytics.test.docker.azure.AzureBestPracticesITD [INFO] Running com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetDPDisabledITD [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.04 s - in com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetDPDisabledITD [INFO] Running com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD 2021-01-13 07:37:37,749 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:37:37.854-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:37:38.229-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:37:38.229-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:37:39.231-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-5fc54bf3-0bdc-421b-b611-e69fe7c19085) 2021-01-13T07:37:39.299-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-5fc54bf3-0bdc-421b-b611-e69fe7c19085, id = b77d1eb3d71ed5c45397386d4671049fc2ae90241d05d6bbf929ab3abc3a7681 } 2021-01-13T07:37:39.303-08:00 INFO DockerTestBase [main] Executing the command: docker pull mcr.microsoft.com/azure-storage/azurite:3.8.0 2021-01-13T07:37:40.610-08:00 INFO DockerTestBase [main+] >> 3.8.0: Pulling from azure-storage/azurite 2021-01-13T07:37:40.611-08:00 INFO DockerTestBase [main+] >> cbdbe7a5bc2a: Pulling fs layer 2021-01-13T07:37:40.611-08:00 INFO DockerTestBase [main+] >> bd07af9ed1a4: Pulling fs layer 2021-01-13T07:37:40.612-08:00 INFO DockerTestBase [main+] >> 3556ccf180b2: Pulling fs layer 2021-01-13T07:37:40.612-08:00 INFO DockerTestBase [main+] >> 089d4748da74: Pulling fs layer 2021-01-13T07:37:40.612-08:00 INFO DockerTestBase [main+] >> 6971638b255d: Pulling fs layer 2021-01-13T07:37:40.612-08:00 INFO DockerTestBase [main+] >> 84e862bb769b: Pulling fs layer 2021-01-13T07:37:40.612-08:00 INFO DockerTestBase [main+] >> 6c4a6b731cae: Pulling fs layer 2021-01-13T07:37:40.613-08:00 INFO DockerTestBase [main+] >> 4f6d04b7d045: Pulling fs layer 2021-01-13T07:37:40.613-08:00 INFO DockerTestBase [main+] >> 1385221e8f87: Pulling fs layer 2021-01-13T07:37:40.613-08:00 INFO DockerTestBase [main+] >> 418c070ee704: Pulling fs layer 2021-01-13T07:37:40.613-08:00 INFO DockerTestBase [main+] >> ef2c1abd1a8a: Pulling fs layer 2021-01-13T07:37:40.613-08:00 INFO DockerTestBase [main+] >> 720542683141: Pulling fs layer 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> 8ef034eecb73: Pulling fs layer 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> d8ac6bf2d5e8: Pulling fs layer 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> 4f6d04b7d045: Waiting 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> 1385221e8f87: Waiting 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> 418c070ee704: Waiting 2021-01-13T07:37:40.614-08:00 INFO DockerTestBase [main+] >> ef2c1abd1a8a: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> 720542683141: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> 8ef034eecb73: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> d8ac6bf2d5e8: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> 6971638b255d: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> 84e862bb769b: Waiting 2021-01-13T07:37:40.615-08:00 INFO DockerTestBase [main+] >> 6c4a6b731cae: Waiting 2021-01-13T07:37:40.616-08:00 INFO DockerTestBase [main+] >> 089d4748da74: Waiting 2021-01-13T07:37:41.917-08:00 INFO DockerTestBase [main+] >> 3556ccf180b2: Verifying Checksum 2021-01-13T07:37:41.918-08:00 INFO DockerTestBase [main+] >> 3556ccf180b2: Download complete 2021-01-13T07:37:42.062-08:00 INFO DockerTestBase [main+] >> cbdbe7a5bc2a: Download complete 2021-01-13T07:37:42.178-08:00 INFO DockerTestBase [main+] >> bd07af9ed1a4: Verifying Checksum 2021-01-13T07:37:42.179-08:00 INFO DockerTestBase [main+] >> bd07af9ed1a4: Download complete 2021-01-13T07:37:42.253-08:00 INFO DockerTestBase [main+] >> 089d4748da74: Verifying Checksum 2021-01-13T07:37:42.254-08:00 INFO DockerTestBase [main+] >> 089d4748da74: Download complete 2021-01-13T07:37:42.281-08:00 INFO DockerTestBase [main+] >> cbdbe7a5bc2a: Pull complete 2021-01-13T07:37:42.444-08:00 INFO DockerTestBase [main+] >> 6971638b255d: Verifying Checksum 2021-01-13T07:37:42.444-08:00 INFO DockerTestBase [main+] >> 6971638b255d: Download complete 2021-01-13T07:37:42.520-08:00 INFO DockerTestBase [main+] >> 84e862bb769b: Download complete 2021-01-13T07:37:42.774-08:00 INFO DockerTestBase [main+] >> 6c4a6b731cae: Download complete 2021-01-13T07:37:42.883-08:00 INFO DockerTestBase [main+] >> 1385221e8f87: Verifying Checksum 2021-01-13T07:37:42.884-08:00 INFO DockerTestBase [main+] >> 1385221e8f87: Download complete 2021-01-13T07:37:43.120-08:00 INFO DockerTestBase [main+] >> 418c070ee704: Download complete 2021-01-13T07:37:43.374-08:00 INFO DockerTestBase [main+] >> 4f6d04b7d045: Verifying Checksum 2021-01-13T07:37:43.375-08:00 INFO DockerTestBase [main+] >> 4f6d04b7d045: Download complete 2021-01-13T07:37:43.376-08:00 INFO DockerTestBase [main+] >> ef2c1abd1a8a: Verifying Checksum 2021-01-13T07:37:43.377-08:00 INFO DockerTestBase [main+] >> ef2c1abd1a8a: Download complete 2021-01-13T07:37:43.868-08:00 INFO DockerTestBase [main+] >> 8ef034eecb73: Download complete 2021-01-13T07:37:44.040-08:00 INFO DockerTestBase [main+] >> bd07af9ed1a4: Pull complete 2021-01-13T07:37:44.082-08:00 INFO DockerTestBase [main+] >> d8ac6bf2d5e8: Verifying Checksum 2021-01-13T07:37:44.083-08:00 INFO DockerTestBase [main+] >> d8ac6bf2d5e8: Download complete 2021-01-13T07:37:44.249-08:00 INFO DockerTestBase [main+] >> 3556ccf180b2: Pull complete 2021-01-13T07:37:44.372-08:00 INFO DockerTestBase [main+] >> 089d4748da74: Pull complete 2021-01-13T07:37:44.489-08:00 INFO DockerTestBase [main+] >> 6971638b255d: Pull complete 2021-01-13T07:37:44.643-08:00 INFO DockerTestBase [main+] >> 84e862bb769b: Pull complete 2021-01-13T07:37:44.764-08:00 INFO DockerTestBase [main+] >> 6c4a6b731cae: Pull complete 2021-01-13T07:37:44.859-08:00 INFO DockerTestBase [main+] >> 4f6d04b7d045: Pull complete 2021-01-13T07:37:44.976-08:00 INFO DockerTestBase [main+] >> 1385221e8f87: Pull complete 2021-01-13T07:37:45.084-08:00 INFO DockerTestBase [main+] >> 418c070ee704: Pull complete 2021-01-13T07:37:45.188-08:00 INFO DockerTestBase [main+] >> ef2c1abd1a8a: Pull complete 2021-01-13T07:37:46.334-08:00 INFO DockerTestBase [main+] >> 720542683141: Verifying Checksum 2021-01-13T07:37:46.334-08:00 INFO DockerTestBase [main+] >> 720542683141: Download complete 2021-01-13T07:37:51.331-08:00 INFO DockerTestBase [main+] >> 720542683141: Pull complete 2021-01-13T07:37:51.629-08:00 INFO DockerTestBase [main+] >> 8ef034eecb73: Pull complete 2021-01-13T07:37:51.729-08:00 INFO DockerTestBase [main+] >> d8ac6bf2d5e8: Pull complete 2021-01-13T07:37:51.735-08:00 INFO DockerTestBase [main+] >> Digest: sha256:f1fdee4a45226659c5afa30b8d8d3a479037c701826d32448078f22a7cd011a4 2021-01-13T07:37:51.740-08:00 INFO DockerTestBase [main+] >> Status: Downloaded newer image for mcr.microsoft.com/azure-storage/azurite:3.8.0 2021-01-13T07:37:51.741-08:00 INFO DockerTestBase [main+] >> mcr.microsoft.com/azure-storage/azurite:3.8.0 2021-01-13T07:37:51.744-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD/0001_azurite_mcr.microsoft.com_azure-storage_azurite_3.8.0, network = { name = cbas-docker-test-0001-5fc54bf3-0bdc-421b-b611-e69fe7c19085, id = b77d1eb3d71ed5c45397386d4671049fc2ae90241d05d6bbf929ab3abc3a7681 }) 2021-01-13T07:37:52.564-08:00 INFO DockerTestBase [main] Container information for c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920: host: azurite.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55764->192.168.176.2:8095, 172.17.0.1:55765->192.168.176.2:8091, 172.17.0.1:55763->192.168.176.2:10000 2021-01-13T07:37:52.565-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:37:52.653-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:37:52.653-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:37:52.653-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:37:52.654-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:37:52.662-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD/0002_cbas_thisbuild, network = { name = cbas-docker-test-0001-5fc54bf3-0bdc-421b-b611-e69fe7c19085, id = b77d1eb3d71ed5c45397386d4671049fc2ae90241d05d6bbf929ab3abc3a7681 }) 2021-01-13T07:37:53.340-08:00 INFO DockerTestBase [main] Container information for d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9: host: cbas.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55776->192.168.176.3:8095, 172.17.0.1:55780->192.168.176.3:8091 2021-01-13T07:38:00.615-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55780] 2021-01-13T07:38:00.628-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node cbas (192.168.176.3) with services: [DATA, ANALYTICS] 2021-01-13T07:38:00.630-08:00 INFO DockerTestBase [main] Executing the command: docker exec d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:38:01.195-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:38:01.231-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:38:14.777-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] +http://172.17.0.1:55780/settings/developerPreview 2021-01-13T07:38:14.796-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Waiting for 'developer preview' condition for up to 30 seconds... 2021-01-13T07:38:14.816-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Developer Preview enabled successfully. 2021-01-13T07:38:14.817-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Creating Azurite Blob Service client 2021-01-13T07:38:15.363-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Azurite Blob Service client created successfully 2021-01-13T07:38:15.364-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Deleting container playground 2021-01-13T07:38:15.979-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Container playground deleted successfully 2021-01-13T07:38:15.979-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] creating container playground 2021-01-13T07:38:16.029-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] container playground created successfully 2021-01-13T07:38:16.029-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Adding JSON files 2021-01-13T07:38:18.883-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] JSON Files added successfully 2021-01-13T07:38:18.884-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Adding CSV files 2021-01-13T07:38:19.322-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] CSV Files added successfully 2021-01-13T07:38:19.322-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Adding TSV files 2021-01-13T07:38:19.801-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] TSV Files added successfully 2021-01-13T07:38:19.802-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Adding a big JSON file 2021-01-13T07:38:21.426-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] JSON file added successfully 2021-01-13T07:38:21.426-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Loading 2999 into over-1000-objects 2021-01-13T07:39:09.389-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Added 2999 files into over-1000-objects successfully 2021-01-13T07:39:09.390-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Deleting container fixed-data 2021-01-13T07:39:09.406-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Container fixed-data deleted successfully 2021-01-13T07:39:09.406-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] creating container fixed-data 2021-01-13T07:39:09.412-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] container fixed-data created successfully 2021-01-13T07:39:09.412-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Loading fixed data to fixed-data 2021-01-13T07:39:09.451-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Deleting container include-exclude 2021-01-13T07:39:09.457-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] Container include-exclude deleted successfully 2021-01-13T07:39:09.458-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] creating container include-exclude 2021-01-13T07:39:09.482-08:00 INFO ClusterAzureBlobStorageExternalDatasetITD [main] container include-exclude created successfully 2021-01-13T07:39:09.690-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 0: external-dataset: common/create-link-api/000] START 2021-01-13T07:39:09.761-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/create-link-api/000 ... 2021-01-13T07:39:09.770-08:00 INFO TestExecutor [main] Executing test file: create-link-api.000.ddl.sqlpp 2021-01-13T07:39:09.958-08:00 INFO TestExecutor [main] Executing test file: create-link-api.001.ddl.sqlpp 2021-01-13T07:39:10.181-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.002.adm 2021-01-13T07:39:10.210-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.003.adm 2021-01-13T07:39:10.243-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.004.adm 2021-01-13T07:39:10.300-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.005.adm 2021-01-13T07:39:10.331-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.006.adm 2021-01-13T07:39:10.356-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.007.adm 2021-01-13T07:39:10.377-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/000/create-link-api.008.adm 2021-01-13T07:39:10.379-08:00 INFO TestExecutor [main] Executing test file: create-link-api.009.ddl.sqlpp 2021-01-13T07:39:10.590-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/create-link-api/000 PASSED 2021-01-13T07:39:10.594-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/create-link-api/000... 2021-01-13T07:39:11.268-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:11.685-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/create-link-api/000 2021-01-13T07:39:11.686-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 0: external-dataset: common/create-link-api/000] SUCCEEDED 2021-01-13T07:39:11.688-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 1: external-dataset/common/create-link-api: 001] START 2021-01-13T07:39:11.689-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/create-link-api/001 ... 2021-01-13T07:39:11.690-08:00 INFO TestExecutor [main] Executing test file: create-link-api.000.ddl.sqlpp 2021-01-13T07:39:11.715-08:00 INFO TestExecutor [main] Executing test file: create-link-api.001.ddl.sqlpp 2021-01-13T07:39:11.785-08:00 ERRO asterix [main] 24088:Required parameter 'type' not supplied 2021-01-13T07:39:11.786-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/create-link-api/001/create-link-api.002.post.http raised an (expected) exception 2021-01-13T07:39:11.787-08:00 INFO TestExecutor [main] Executing test file: create-link-api.003.ddl.sqlpp 2021-01-13T07:39:11.862-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/create-link-api/001 PASSED 2021-01-13T07:39:11.863-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/create-link-api: 001... 2021-01-13T07:39:11.933-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:12.200-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/create-link-api: 001 2021-01-13T07:39:12.200-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 1: external-dataset/common/create-link-api: 001] SUCCEEDED 2021-01-13T07:39:12.202-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 2: external-dataset/azure_blob_storage/create-link-api: 002] START 2021-01-13T07:39:12.202-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/azure_blob_storage/create-link-api/002 ... 2021-01-13T07:39:12.203-08:00 INFO TestExecutor [main] Executing test file: create-link-api.000.ddl.sqlpp 2021-01-13T07:39:12.228-08:00 INFO TestExecutor [main] Executing test file: create-link-api.001.ddl.sqlpp 2021-01-13T07:39:12.288-08:00 ERRO asterix [main] 24088:Required parameter 'accountKey' not supplied 2021-01-13T07:39:12.288-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/azure_blob_storage/create-link-api/002/create-link-api.002.post.http raised an (expected) exception 2021-01-13T07:39:12.289-08:00 INFO TestExecutor [main] Executing test file: create-link-api.003.ddl.sqlpp 2021-01-13T07:39:12.341-08:00 INFO TestExecutor [main] [TEST]: external-dataset/azure_blob_storage/create-link-api/002 PASSED 2021-01-13T07:39:12.341-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/azure_blob_storage/create-link-api: 002... 2021-01-13T07:39:12.397-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:12.645-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/azure_blob_storage/create-link-api: 002 2021-01-13T07:39:12.645-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 2: external-dataset/azure_blob_storage/create-link-api: 002] SUCCEEDED 2021-01-13T07:39:12.647-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 3: external-dataset/azure_blob_storage/create-link-api: 003] START 2021-01-13T07:39:12.647-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/azure_blob_storage/create-link-api/003 ... 2021-01-13T07:39:12.648-08:00 INFO TestExecutor [main] Executing test file: create-link-api.000.ddl.sqlpp 2021-01-13T07:39:12.680-08:00 INFO TestExecutor [main] Executing test file: create-link-api.001.ddl.sqlpp 2021-01-13T07:39:12.746-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/create-link-api/003/create-link-api.002.txt 2021-01-13T07:39:12.746-08:00 INFO TestExecutor [main] Executing test file: create-link-api.003.ddl.sqlpp 2021-01-13T07:39:12.786-08:00 INFO TestExecutor [main] [TEST]: external-dataset/azure_blob_storage/create-link-api/003 PASSED 2021-01-13T07:39:12.787-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/azure_blob_storage/create-link-api: 003... 2021-01-13T07:39:12.870-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:13.107-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/azure_blob_storage/create-link-api: 003 2021-01-13T07:39:13.107-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 3: external-dataset/azure_blob_storage/create-link-api: 003] SUCCEEDED 2021-01-13T07:39:13.108-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 4: external-dataset/common/create-dataset: 000] START 2021-01-13T07:39:13.109-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/create-dataset/000 ... 2021-01-13T07:39:13.110-08:00 INFO TestExecutor [main] Executing test file: create-dataset.000.ddl.sqlpp 2021-01-13T07:39:13.290-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/create-dataset/000/create-dataset.001.adm 2021-01-13T07:39:13.353-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/create-dataset/000/create-dataset.002.adm 2021-01-13T07:39:13.354-08:00 INFO TestExecutor [main] Executing test file: create-dataset.003.ddl.sqlpp 2021-01-13T07:39:14.244-08:00 INFO TestExecutor [main] Executing test file: create-dataset.004.ddl.sqlpp 2021-01-13T07:39:14.376-08:00 INFO TestExecutor [main] Executing test file: create-dataset.005.ddl.sqlpp 2021-01-13T07:39:14.620-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/create-dataset/000/create-dataset.006.adm 2021-01-13T07:39:14.622-08:00 INFO TestExecutor [main] Executing test file: create-dataset.007.ddl.sqlpp 2021-01-13T07:39:14.760-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/create-dataset/000 PASSED 2021-01-13T07:39:14.761-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/create-dataset: 000... 2021-01-13T07:39:14.822-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:15.043-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/create-dataset: 000 2021-01-13T07:39:15.043-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 4: external-dataset/common/create-dataset: 000] SUCCEEDED 2021-01-13T07:39:15.044-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 5: external-dataset/common/create-dataset: 001] START 2021-01-13T07:39:15.044-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/create-dataset/001 ... 2021-01-13T07:39:15.045-08:00 INFO TestExecutor [main] Executing test file: create-dataset.000.ddl.sqlpp 2021-01-13T07:39:15.138-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/create-dataset/001/create-dataset.000.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:15.139-08:00 INFO TestExecutor [main] Executing test file: create-dataset.001.ddl.sqlpp 2021-01-13T07:39:15.260-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/create-dataset/001/create-dataset.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:15.261-08:00 INFO TestExecutor [main] Executing test file: create-dataset.002.ddl.sqlpp 2021-01-13T07:39:15.360-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/create-dataset/001 PASSED 2021-01-13T07:39:15.360-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/create-dataset: 001... 2021-01-13T07:39:15.416-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:15.667-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/create-dataset: 001 2021-01-13T07:39:15.668-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 5: external-dataset/common/create-dataset: 001] SUCCEEDED 2021-01-13T07:39:15.669-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 6: external-dataset/common/drop-link: 000] START 2021-01-13T07:39:15.669-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/drop-link/000 ... 2021-01-13T07:39:15.670-08:00 INFO TestExecutor [main] Executing test file: drop-link.000.ddl.sqlpp 2021-01-13T07:39:15.870-08:00 INFO TestExecutor [main] Executing test file: drop-link.001.ddl.sqlpp 2021-01-13T07:39:15.911-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/drop-link/000/drop-link.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:15.912-08:00 INFO TestExecutor [main] Executing test file: drop-link.002.ddl.sqlpp 2021-01-13T07:39:15.992-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/drop-link/000/drop-link.003.adm 2021-01-13T07:39:15.993-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/drop-link/000 PASSED 2021-01-13T07:39:15.994-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/drop-link: 000... 2021-01-13T07:39:16.032-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:16.065-08:00 INFO TestExecutor [main] Disconnecting link test.Local 2021-01-13T07:39:16.267-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test 2021-01-13T07:39:16.313-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/drop-link: 000 2021-01-13T07:39:16.313-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 6: external-dataset/common/drop-link: 000] SUCCEEDED 2021-01-13T07:39:16.314-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 7: external-dataset/common/query-dataset: json/json] START 2021-01-13T07:39:16.315-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/json/json ... 2021-01-13T07:39:16.315-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:16.428-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.001.adm 2021-01-13T07:39:16.429-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:17.162-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.003.adm 2021-01-13T07:39:17.339-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.004.adm 2021-01-13T07:39:17.491-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.005.adm 2021-01-13T07:39:17.662-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.006.adm 2021-01-13T07:39:17.841-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.007.adm 2021-01-13T07:39:17.996-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.008.adm 2021-01-13T07:39:18.574-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/json/external_dataset.009.adm 2021-01-13T07:39:18.575-08:00 INFO TestExecutor [main] Executing test file: query-dataset.099.ddl.sqlpp 2021-01-13T07:39:18.757-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/json/json PASSED 2021-01-13T07:39:18.758-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: json/json... 2021-01-13T07:39:18.798-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:18.876-08:00 INFO TestExecutor [main] Disconnecting link test2.Local 2021-01-13T07:39:19.109-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test2 2021-01-13T07:39:19.165-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: json/json 2021-01-13T07:39:19.165-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 7: external-dataset/common/query-dataset: json/json] SUCCEEDED 2021-01-13T07:39:19.166-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 8: external-dataset/common/query-dataset: json/gz] START 2021-01-13T07:39:19.166-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/json/gz ... 2021-01-13T07:39:19.167-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:19.296-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.001.adm 2021-01-13T07:39:19.297-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:19.656-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.003.adm 2021-01-13T07:39:19.875-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.004.adm 2021-01-13T07:39:20.072-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.005.adm 2021-01-13T07:39:20.254-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.006.adm 2021-01-13T07:39:20.419-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.007.adm 2021-01-13T07:39:20.583-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/gz/external_dataset.008.adm 2021-01-13T07:39:20.592-08:00 INFO TestExecutor [main] Executing test file: query-dataset.009.ddl.sqlpp 2021-01-13T07:39:20.629-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/json/gz PASSED 2021-01-13T07:39:20.629-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: json/gz... 2021-01-13T07:39:20.688-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:20.709-08:00 INFO TestExecutor [main] Disconnecting link test2.Local 2021-01-13T07:39:20.884-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test2 2021-01-13T07:39:20.926-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: json/gz 2021-01-13T07:39:20.926-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 8: external-dataset/common/query-dataset: json/gz] SUCCEEDED 2021-01-13T07:39:20.927-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 9: external-dataset/common/query-dataset: json/mixed] START 2021-01-13T07:39:20.928-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/json/mixed ... 2021-01-13T07:39:20.928-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:21.038-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.001.adm 2021-01-13T07:39:21.039-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:21.538-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.003.adm 2021-01-13T07:39:21.765-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.004.adm 2021-01-13T07:39:22.017-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.005.adm 2021-01-13T07:39:22.239-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.006.adm 2021-01-13T07:39:22.471-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.007.adm 2021-01-13T07:39:22.698-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/json/mixed/external_dataset.008.adm 2021-01-13T07:39:22.699-08:00 INFO TestExecutor [main] Executing test file: query-dataset.009.ddl.sqlpp 2021-01-13T07:39:22.748-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/json/mixed PASSED 2021-01-13T07:39:22.748-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: json/mixed... 2021-01-13T07:39:22.789-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:22.812-08:00 INFO TestExecutor [main] Disconnecting link test2.Local 2021-01-13T07:39:22.954-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test2 2021-01-13T07:39:23.013-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: json/mixed 2021-01-13T07:39:23.013-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 9: external-dataset/common/query-dataset: json/mixed] SUCCEEDED 2021-01-13T07:39:23.014-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 10: external-dataset/common/query-dataset: csv/csv] START 2021-01-13T07:39:23.014-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/csv/csv ... 2021-01-13T07:39:23.015-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:23.090-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/csv/query-dataset.000.adm 2021-01-13T07:39:23.091-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:23.354-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/csv/query-dataset.003.adm 2021-01-13T07:39:23.355-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:23.402-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/csv/csv PASSED 2021-01-13T07:39:23.402-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: csv/csv... 2021-01-13T07:39:23.445-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:23.641-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: csv/csv 2021-01-13T07:39:23.642-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 10: external-dataset/common/query-dataset: csv/csv] SUCCEEDED 2021-01-13T07:39:23.645-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 11: external-dataset/common/query-dataset: csv/gz] START 2021-01-13T07:39:23.645-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/csv/gz ... 2021-01-13T07:39:23.646-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:23.737-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/gz/query-dataset.000.adm 2021-01-13T07:39:23.738-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:24.036-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/gz/query-dataset.003.adm 2021-01-13T07:39:24.037-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:24.193-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/csv/gz PASSED 2021-01-13T07:39:24.194-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: csv/gz... 2021-01-13T07:39:24.229-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:24.448-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: csv/gz 2021-01-13T07:39:24.449-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 11: external-dataset/common/query-dataset: csv/gz] SUCCEEDED 2021-01-13T07:39:24.449-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 12: external-dataset/common/query-dataset: csv/mixed] START 2021-01-13T07:39:24.450-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/csv/mixed ... 2021-01-13T07:39:24.451-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:24.607-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/mixed/query-dataset.000.adm 2021-01-13T07:39:24.608-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:25.130-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/csv/mixed/query-dataset.003.adm 2021-01-13T07:39:25.131-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:25.170-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/csv/mixed PASSED 2021-01-13T07:39:25.171-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: csv/mixed... 2021-01-13T07:39:25.226-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:25.405-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: csv/mixed 2021-01-13T07:39:25.405-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 12: external-dataset/common/query-dataset: csv/mixed] SUCCEEDED 2021-01-13T07:39:25.406-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 13: external-dataset/common/query-dataset: tsv/tsv] START 2021-01-13T07:39:25.406-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/tsv/tsv ... 2021-01-13T07:39:25.407-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:25.474-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/tsv/query-dataset.000.adm 2021-01-13T07:39:25.475-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:25.774-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/tsv/query-dataset.003.adm 2021-01-13T07:39:25.775-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:25.844-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/tsv/tsv PASSED 2021-01-13T07:39:25.844-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: tsv/tsv... 2021-01-13T07:39:25.884-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:26.079-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: tsv/tsv 2021-01-13T07:39:26.080-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 13: external-dataset/common/query-dataset: tsv/tsv] SUCCEEDED 2021-01-13T07:39:26.081-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 14: external-dataset/common/query-dataset: tsv/gz] START 2021-01-13T07:39:26.081-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/tsv/gz ... 2021-01-13T07:39:26.082-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:26.165-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/gz/query-dataset.000.adm 2021-01-13T07:39:26.167-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:26.495-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/gz/query-dataset.003.adm 2021-01-13T07:39:26.496-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:26.539-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/tsv/gz PASSED 2021-01-13T07:39:26.540-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: tsv/gz... 2021-01-13T07:39:26.581-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:26.738-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: tsv/gz 2021-01-13T07:39:26.739-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 14: external-dataset/common/query-dataset: tsv/gz] SUCCEEDED 2021-01-13T07:39:26.740-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 15: external-dataset/common/query-dataset: tsv/mixed] START 2021-01-13T07:39:26.741-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/tsv/mixed ... 2021-01-13T07:39:26.742-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:26.804-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/mixed/query-dataset.000.adm 2021-01-13T07:39:26.805-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:27.257-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/tsv/mixed/query-dataset.003.adm 2021-01-13T07:39:27.258-08:00 INFO TestExecutor [main] Executing test file: query-dataset.004.ddl.sqlpp 2021-01-13T07:39:27.303-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/tsv/mixed PASSED 2021-01-13T07:39:27.304-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: tsv/mixed... 2021-01-13T07:39:27.337-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:27.496-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: tsv/mixed 2021-01-13T07:39:27.497-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 15: external-dataset/common/query-dataset: tsv/mixed] SUCCEEDED 2021-01-13T07:39:27.498-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 16: external-dataset/common/query-dataset: empty-string-definition] START 2021-01-13T07:39:27.498-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/empty-string-definition ... 2021-01-13T07:39:27.499-08:00 INFO TestExecutor [main] Executing test file: query-dataset.000.ddl.sqlpp 2021-01-13T07:39:27.569-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/empty-string-definition/external_dataset.001.adm 2021-01-13T07:39:27.571-08:00 INFO TestExecutor [main] Executing test file: query-dataset.002.ddl.sqlpp 2021-01-13T07:39:27.751-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/empty-string-definition/external_dataset.003.adm 2021-01-13T07:39:27.752-08:00 INFO TestExecutor [main] Executing test file: query-dataset.099.ddl.sqlpp 2021-01-13T07:39:27.789-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/empty-string-definition PASSED 2021-01-13T07:39:27.789-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: empty-string-definition... 2021-01-13T07:39:27.839-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:28.053-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: empty-string-definition 2021-01-13T07:39:28.054-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 16: external-dataset/common/query-dataset: empty-string-definition] SUCCEEDED 2021-01-13T07:39:28.054-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 17: external-dataset/common/query-dataset: over-1000-objects] START 2021-01-13T07:39:28.054-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/over-1000-objects ... 2021-01-13T07:39:28.055-08:00 INFO TestExecutor [main] Executing test file: over-1000-objects.000.ddl.sqlpp 2021-01-13T07:39:28.132-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/over-1000-objects/over-1000-objects.001.adm 2021-01-13T07:39:28.132-08:00 INFO TestExecutor [main] Executing test file: over-1000-objects.002.ddl.sqlpp 2021-01-13T07:39:53.345-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/over-1000-objects/over-1000-objects.003.adm 2021-01-13T07:39:53.346-08:00 INFO TestExecutor [main] Executing test file: over-1000-objects.099.ddl.sqlpp 2021-01-13T07:39:53.395-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/over-1000-objects PASSED 2021-01-13T07:39:53.395-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: over-1000-objects... 2021-01-13T07:39:53.431-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:53.584-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: over-1000-objects 2021-01-13T07:39:53.584-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 17: external-dataset/common/query-dataset: over-1000-objects] SUCCEEDED 2021-01-13T07:39:53.585-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 18: external-dataset/azure_blob_storage/alter-drop-link: alter-to-invalid-link-endpoint] START 2021-01-13T07:39:53.585-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint ... 2021-01-13T07:39:53.586-08:00 INFO TestExecutor [main] Executing test file: alter-to-invalid-link-endpoint.000.ddl.sqlpp 2021-01-13T07:39:53.641-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint/alter-to-invalid-link-endpoint.001.adm 2021-01-13T07:39:53.642-08:00 INFO TestExecutor [main] Executing test file: alter-to-invalid-link-endpoint.002.ddl.sqlpp 2021-01-13T07:39:53.771-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint/alter-to-invalid-link-endpoint.003.adm 2021-01-13T07:39:53.803-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint/alter-to-invalid-link-endpoint.004.adm 2021-01-13T07:39:53.849-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint/alter-to-invalid-link-endpoint.005.query.sqlpp raised an (expected) exception 2021-01-13T07:39:53.850-08:00 INFO TestExecutor [main] Executing test file: alter-to-invalid-link-endpoint.006.ddl.sqlpp 2021-01-13T07:39:53.890-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint/alter-to-invalid-link-endpoint.006.adm 2021-01-13T07:39:53.891-08:00 INFO TestExecutor [main] Executing test file: alter-to-invalid-link-endpoint.999.ddl.sqlpp 2021-01-13T07:39:53.925-08:00 INFO TestExecutor [main] [TEST]: external-dataset/azure_blob_storage/alter-drop-link/alter-to-invalid-link-endpoint PASSED 2021-01-13T07:39:53.925-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/azure_blob_storage/alter-drop-link: alter-to-invalid-link-endpoint... 2021-01-13T07:39:53.960-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:54.101-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/azure_blob_storage/alter-drop-link: alter-to-invalid-link-endpoint 2021-01-13T07:39:54.101-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 18: external-dataset/azure_blob_storage/alter-drop-link: alter-to-invalid-link-endpoint] SUCCEEDED 2021-01-13T07:39:54.105-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 19: external-dataset/common/alter-drop-link: drop-link-has-datasets] START 2021-01-13T07:39:54.105-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/alter-drop-link/drop-link-has-datasets ... 2021-01-13T07:39:54.106-08:00 INFO TestExecutor [main] Executing test file: drop-link-has-datasets.000.ddl.sqlpp 2021-01-13T07:39:54.173-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/alter-drop-link/drop-link-has-datasets/drop-link-has-datasets.001.adm 2021-01-13T07:39:54.174-08:00 INFO TestExecutor [main] Executing test file: drop-link-has-datasets.002.ddl.sqlpp 2021-01-13T07:39:54.276-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/alter-drop-link/drop-link-has-datasets/drop-link-has-datasets.003.adm 2021-01-13T07:39:54.306-08:00 ERRO asterix [main] 23004:Link test.myLink cannot be dropped because it has the following datasets [test.test] 2021-01-13T07:39:54.310-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/alter-drop-link/drop-link-has-datasets/drop-link-has-datasets.004.delete.http raised an (expected) exception 2021-01-13T07:39:54.311-08:00 INFO TestExecutor [main] Executing test file: drop-link-has-datasets.005.ddl.sqlpp 2021-01-13T07:39:54.353-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/alter-drop-link/drop-link-has-datasets/drop-link-has-datasets.006.adm 2021-01-13T07:39:54.354-08:00 INFO TestExecutor [main] Executing test file: drop-link-has-datasets.007.ddl.sqlpp 2021-01-13T07:39:54.422-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/alter-drop-link/drop-link-has-datasets PASSED 2021-01-13T07:39:54.423-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/alter-drop-link: drop-link-has-datasets... 2021-01-13T07:39:54.457-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:54.591-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/alter-drop-link: drop-link-has-datasets 2021-01-13T07:39:54.591-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 19: external-dataset/common/alter-drop-link: drop-link-has-datasets] SUCCEEDED 2021-01-13T07:39:54.592-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 20: external-dataset/common/query-dataset: definition-does-not-exist] START 2021-01-13T07:39:54.592-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/query-dataset/definition-does-not-exist ... 2021-01-13T07:39:54.593-08:00 INFO TestExecutor [main] Executing test file: test.000.ddl.sqlpp 2021-01-13T07:39:54.651-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/definition-does-not-exist/result.001.adm 2021-01-13T07:39:54.651-08:00 INFO TestExecutor [main] Executing test file: test.002.ddl.sqlpp 2021-01-13T07:39:54.748-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/query-dataset/definition-does-not-exist/result.003.adm 2021-01-13T07:39:54.748-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:39:54.781-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/query-dataset/definition-does-not-exist PASSED 2021-01-13T07:39:54.782-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/query-dataset: definition-does-not-exist... 2021-01-13T07:39:54.808-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:54.969-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/query-dataset: definition-does-not-exist 2021-01-13T07:39:54.969-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 20: external-dataset/common/query-dataset: definition-does-not-exist] SUCCEEDED 2021-01-13T07:39:54.970-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 21: external-dataset/common/negative: 000] START 2021-01-13T07:39:54.970-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/negative/000 ... 2021-01-13T07:39:54.971-08:00 INFO TestExecutor [main] Executing test file: negative.000.ddl.sqlpp 2021-01-13T07:39:55.035-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/negative/000/negative.000.adm 2021-01-13T07:39:55.038-08:00 INFO TestExecutor [main] Executing test file: negative.002.ddl.sqlpp 2021-01-13T07:39:55.084-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/000/negative.002.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:55.084-08:00 INFO TestExecutor [main] Executing test file: negative.003.ddl.sqlpp 2021-01-13T07:39:55.140-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/000/negative.003.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:55.140-08:00 INFO TestExecutor [main] Executing test file: negative.004.ddl.sqlpp 2021-01-13T07:39:55.193-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/000/negative.004.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:55.194-08:00 INFO TestExecutor [main] Executing test file: negative.005.ddl.sqlpp 2021-01-13T07:39:55.254-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/000/negative.005.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:55.254-08:00 INFO TestExecutor [main] Executing test file: negative.006.ddl.sqlpp 2021-01-13T07:39:56.218-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/000/negative.007.query.sqlpp raised an (expected) exception 2021-01-13T07:39:56.218-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/negative/000 PASSED 2021-01-13T07:39:56.218-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/negative: 000... 2021-01-13T07:39:56.248-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:56.269-08:00 INFO TestExecutor [main] Disconnecting link test.Local 2021-01-13T07:39:56.407-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test 2021-01-13T07:39:56.453-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/negative: 000 2021-01-13T07:39:56.454-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 21: external-dataset/common/negative: 000] SUCCEEDED 2021-01-13T07:39:56.455-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 22: external-dataset/common/negative: create-index] START 2021-01-13T07:39:56.455-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/negative/create-index ... 2021-01-13T07:39:56.456-08:00 INFO TestExecutor [main] Executing test file: create-index.000.ddl.sqlpp 2021-01-13T07:39:56.519-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/negative/000/negative.000.adm 2021-01-13T07:39:56.519-08:00 INFO TestExecutor [main] Executing test file: create-index.002.ddl.sqlpp 2021-01-13T07:39:56.576-08:00 INFO TestExecutor [main] Executing test file: create-index.003.ddl.sqlpp 2021-01-13T07:39:56.595-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/negative/create-index/create-index.003.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:56.595-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/negative/create-index PASSED 2021-01-13T07:39:56.596-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/negative: create-index... 2021-01-13T07:39:56.640-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:56.661-08:00 INFO TestExecutor [main] Disconnecting link test.Local 2021-01-13T07:39:56.787-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test 2021-01-13T07:39:56.819-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/negative: create-index 2021-01-13T07:39:56.820-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 22: external-dataset/common/negative: create-index] SUCCEEDED 2021-01-13T07:39:56.821-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 23: external-dataset/common/: reserved-link-name] START 2021-01-13T07:39:56.821-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//reserved-link-name ... 2021-01-13T07:39:56.835-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/reserved-link-name/reserved-link-name.000.txt 2021-01-13T07:39:56.836-08:00 INFO TestExecutor [main] Executing test file: reserved-link-name.001.ddl.sqlpp 2021-01-13T07:39:56.853-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/reserved-link-name/reserved-link-name.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:56.853-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//reserved-link-name PASSED 2021-01-13T07:39:56.853-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: reserved-link-name... 2021-01-13T07:39:56.879-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:57.006-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: reserved-link-name 2021-01-13T07:39:57.007-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 23: external-dataset/common/: reserved-link-name] SUCCEEDED 2021-01-13T07:39:57.007-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 24: external-dataset/parameters-validation: invalid-parameters] START 2021-01-13T07:39:57.007-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/parameters-validation/invalid-parameters ... 2021-01-13T07:39:57.008-08:00 INFO TestExecutor [main] Executing test file: invalid-parameters.001.ddl.sqlpp 2021-01-13T07:39:57.060-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/parameters-validation/invalid-parameters/invalid-parameters.001.adm 2021-01-13T07:39:57.061-08:00 INFO TestExecutor [main] Executing test file: invalid-parameters.003.ddl.sqlpp 2021-01-13T07:39:57.087-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/parameters-validation/invalid-parameters/invalid-parameters.003.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.088-08:00 INFO TestExecutor [main] Executing test file: invalid-parameters.004.ddl.sqlpp 2021-01-13T07:39:57.112-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/parameters-validation/invalid-parameters/invalid-parameters.004.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.112-08:00 INFO TestExecutor [main] Executing test file: invalid-parameters.005.ddl.sqlpp 2021-01-13T07:39:57.173-08:00 INFO TestExecutor [main] [TEST]: external-dataset/parameters-validation/invalid-parameters PASSED 2021-01-13T07:39:57.173-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/parameters-validation: invalid-parameters... 2021-01-13T07:39:57.201-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:57.338-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/parameters-validation: invalid-parameters 2021-01-13T07:39:57.338-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 24: external-dataset/parameters-validation: invalid-parameters] SUCCEEDED 2021-01-13T07:39:57.339-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 25: external-dataset/common/: invalid-dataset-name] START 2021-01-13T07:39:57.339-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//invalid-dataset-name ... 2021-01-13T07:39:57.356-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-dataset-name/invalid-dataset-name.1.adm 2021-01-13T07:39:57.357-08:00 INFO TestExecutor [main] Executing test file: invalid-dataset-name.2.ddl.sqlpp 2021-01-13T07:39:57.378-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataset-name/invalid-dataset-name.2.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.379-08:00 INFO TestExecutor [main] Executing test file: invalid-dataset-name.3.ddl.sqlpp 2021-01-13T07:39:57.393-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataset-name/invalid-dataset-name.3.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.393-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//invalid-dataset-name PASSED 2021-01-13T07:39:57.393-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: invalid-dataset-name... 2021-01-13T07:39:57.419-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:57.582-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: invalid-dataset-name 2021-01-13T07:39:57.582-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 25: external-dataset/common/: invalid-dataset-name] SUCCEEDED 2021-01-13T07:39:57.583-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 26: external-dataset/common/: invalid-dataverse] START 2021-01-13T07:39:57.583-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//invalid-dataverse ... 2021-01-13T07:39:57.600-08:00 ERRO asterix [main] 24034:Cannot find dataverse with name fakeDataverse 2021-01-13T07:39:57.600-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.000.post.http raised an (expected) exception 2021-01-13T07:39:57.624-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-dataverse/invalid-dataverse.001.adm 2021-01-13T07:39:57.624-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.002.ddl.sqlpp 2021-01-13T07:39:57.642-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.002.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.643-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.003.ddl.sqlpp 2021-01-13T07:39:57.665-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.004.ddl.sqlpp 2021-01-13T07:39:57.683-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.004.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.683-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.005.ddl.sqlpp 2021-01-13T07:39:57.709-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.005.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:57.710-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.006.ddl.sqlpp 2021-01-13T07:39:57.739-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.007.ddl.sqlpp 2021-01-13T07:39:57.850-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-dataverse/invalid-dataverse.008.adm 2021-01-13T07:39:57.927-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-dataverse/invalid-dataverse.009.adm 2021-01-13T07:39:57.928-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.010.ddl.sqlpp 2021-01-13T07:39:57.951-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.010.ddl.sqlpp issued an (expected) warning 2021-01-13T07:39:57.952-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.011.ddl.sqlpp 2021-01-13T07:39:57.971-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.012.ddl.sqlpp 2021-01-13T07:39:58.013-08:00 ERRO asterix [main] 24034:Cannot find dataverse with name fakeDataverse 2021-01-13T07:39:58.014-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.013.delete.http raised an (expected) exception 2021-01-13T07:39:58.029-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-dataverse/invalid-dataverse.014.adm 2021-01-13T07:39:58.030-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.015.ddl.sqlpp 2021-01-13T07:39:58.046-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-dataverse/invalid-dataverse.015.ddl.sqlpp issued an (expected) warning 2021-01-13T07:39:58.047-08:00 INFO TestExecutor [main] Executing test file: invalid-dataverse.016.ddl.sqlpp 2021-01-13T07:39:58.078-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//invalid-dataverse PASSED 2021-01-13T07:39:58.078-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: invalid-dataverse... 2021-01-13T07:39:58.109-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:58.263-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: invalid-dataverse 2021-01-13T07:39:58.264-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 26: external-dataset/common/: invalid-dataverse] SUCCEEDED 2021-01-13T07:39:58.265-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 27: external-dataset/common/: invalid-schema/schema-for-json] START 2021-01-13T07:39:58.265-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//invalid-schema/schema-for-json ... 2021-01-13T07:39:58.266-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:39:58.316-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-schema/schema-for-json/result.000.adm 2021-01-13T07:39:58.317-08:00 INFO TestExecutor [main] Executing test file: test.003.ddl.sqlpp 2021-01-13T07:39:58.412-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-schema/schema-for-json/test.003.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:58.414-08:00 INFO TestExecutor [main] Executing test file: test.004.ddl.sqlpp 2021-01-13T07:39:58.442-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-schema/schema-for-json/test.004.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:58.442-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//invalid-schema/schema-for-json PASSED 2021-01-13T07:39:58.443-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: invalid-schema/schema-for-json... 2021-01-13T07:39:58.473-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:58.493-08:00 INFO TestExecutor [main] Disconnecting link test.Local 2021-01-13T07:39:58.613-08:00 INFO TestExecutor [main] Last test left some garbage. Dropping dataverses: test 2021-01-13T07:39:58.646-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: invalid-schema/schema-for-json 2021-01-13T07:39:58.646-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 27: external-dataset/common/: invalid-schema/schema-for-json] SUCCEEDED 2021-01-13T07:39:58.647-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 28: external-dataset/common/: invalid-schema/no-schema-for-csv] START 2021-01-13T07:39:58.647-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//invalid-schema/no-schema-for-csv ... 2021-01-13T07:39:58.666-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-schema/no-schema-for-csv/result.000.adm 2021-01-13T07:39:58.667-08:00 INFO TestExecutor [main] Executing test file: test.002.ddl.sqlpp 2021-01-13T07:39:58.692-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-schema/no-schema-for-csv/test.002.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:58.695-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//invalid-schema/no-schema-for-csv PASSED 2021-01-13T07:39:58.695-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: invalid-schema/no-schema-for-csv... 2021-01-13T07:39:58.720-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:58.897-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: invalid-schema/no-schema-for-csv 2021-01-13T07:39:58.897-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 28: external-dataset/common/: invalid-schema/no-schema-for-csv] SUCCEEDED 2021-01-13T07:39:58.897-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 29: external-dataset/common/: invalid-schema/no-schema-for-tsv] START 2021-01-13T07:39:58.898-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//invalid-schema/no-schema-for-tsv ... 2021-01-13T07:39:58.916-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/invalid-schema/no-schema-for-tsv/result.000.adm 2021-01-13T07:39:58.916-08:00 INFO TestExecutor [main] Executing test file: test.002.ddl.sqlpp 2021-01-13T07:39:58.944-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/invalid-schema/no-schema-for-tsv/test.002.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:58.944-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//invalid-schema/no-schema-for-tsv PASSED 2021-01-13T07:39:58.944-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: invalid-schema/no-schema-for-tsv... 2021-01-13T07:39:58.972-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:59.144-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: invalid-schema/no-schema-for-tsv 2021-01-13T07:39:59.145-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 29: external-dataset/common/: invalid-schema/no-schema-for-tsv] SUCCEEDED 2021-01-13T07:39:59.145-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 30: external-dataset/common/: bucket-does-not-exist] START 2021-01-13T07:39:59.145-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common//bucket-does-not-exist ... 2021-01-13T07:39:59.146-08:00 INFO TestExecutor [main] Executing test file: test.000.ddl.sqlpp 2021-01-13T07:39:59.198-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/bucket-does-not-exist/result.001.adm 2021-01-13T07:39:59.199-08:00 INFO TestExecutor [main] Executing test file: test.002.ddl.sqlpp 2021-01-13T07:39:59.259-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/bucket-does-not-exist/test.002.ddl.sqlpp raised an (expected) exception 2021-01-13T07:39:59.259-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:39:59.286-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common//bucket-does-not-exist PASSED 2021-01-13T07:39:59.287-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset/common/: bucket-does-not-exist... 2021-01-13T07:39:59.313-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:59.443-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset/common/: bucket-does-not-exist 2021-01-13T07:39:59.443-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 30: external-dataset/common/: bucket-does-not-exist] SUCCEEDED 2021-01-13T07:39:59.443-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 31: external-dataset: common/no-files-returned/definition-points-to-nothing] START 2021-01-13T07:39:59.444-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/no-files-returned/definition-points-to-nothing ... 2021-01-13T07:39:59.464-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/definition-points-to-nothing/result.000.adm 2021-01-13T07:39:59.465-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:39:59.496-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/no-files-returned/definition-points-to-nothing/test.001.ddl.sqlpp issued an (expected) warning 2021-01-13T07:39:59.534-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/definition-points-to-nothing/result.002.adm 2021-01-13T07:39:59.534-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/no-files-returned/definition-points-to-nothing/test.002.query.sqlpp issued an (expected) warning 2021-01-13T07:39:59.534-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/no-files-returned/definition-points-to-nothing PASSED 2021-01-13T07:39:59.534-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/no-files-returned/definition-points-to-nothing... 2021-01-13T07:39:59.563-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:59.632-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:39:59.732-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/no-files-returned/definition-points-to-nothing 2021-01-13T07:39:59.732-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 31: external-dataset: common/no-files-returned/definition-points-to-nothing] SUCCEEDED 2021-01-13T07:39:59.741-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 32: external-dataset: common/no-files-returned/exclude-all-files] START 2021-01-13T07:39:59.741-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/no-files-returned/exclude-all-files ... 2021-01-13T07:39:59.778-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/exclude-all-files/result.000.adm 2021-01-13T07:39:59.778-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:39:59.871-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/exclude-all-files/result.002.adm 2021-01-13T07:39:59.871-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/no-files-returned/exclude-all-files/test.002.query.sqlpp issued an (expected) warning 2021-01-13T07:39:59.871-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/no-files-returned/exclude-all-files PASSED 2021-01-13T07:39:59.871-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/no-files-returned/exclude-all-files... 2021-01-13T07:39:59.894-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:39:59.961-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:00.060-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/no-files-returned/exclude-all-files 2021-01-13T07:40:00.060-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 32: external-dataset: common/no-files-returned/exclude-all-files] SUCCEEDED 2021-01-13T07:40:00.060-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 33: external-dataset: common/no-files-returned/include-no-files] START 2021-01-13T07:40:00.061-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/no-files-returned/include-no-files ... 2021-01-13T07:40:00.077-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/include-no-files/result.000.adm 2021-01-13T07:40:00.078-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:00.148-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/no-files-returned/include-no-files/result.002.adm 2021-01-13T07:40:00.149-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/no-files-returned/include-no-files/test.002.query.sqlpp issued an (expected) warning 2021-01-13T07:40:00.149-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/no-files-returned/include-no-files PASSED 2021-01-13T07:40:00.149-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/no-files-returned/include-no-files... 2021-01-13T07:40:00.180-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:00.247-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:00.355-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/no-files-returned/include-no-files 2021-01-13T07:40:00.355-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 33: external-dataset: common/no-files-returned/include-no-files] SUCCEEDED 2021-01-13T07:40:00.355-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 34: external-dataset: common/include-exclude/bad-name-1] START 2021-01-13T07:40:00.355-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/bad-name-1 ... 2021-01-13T07:40:00.372-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/bad-name-1/result.000.adm 2021-01-13T07:40:00.373-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:00.407-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/bad-name-1/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:00.408-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:00.420-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/bad-name-1 PASSED 2021-01-13T07:40:00.420-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/bad-name-1... 2021-01-13T07:40:00.442-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:00.591-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/bad-name-1 2021-01-13T07:40:00.591-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 34: external-dataset: common/include-exclude/bad-name-1] SUCCEEDED 2021-01-13T07:40:00.592-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 35: external-dataset: common/include-exclude/bad-name-2] START 2021-01-13T07:40:00.592-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/bad-name-2 ... 2021-01-13T07:40:00.606-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/bad-name-2/result.000.adm 2021-01-13T07:40:00.607-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:00.630-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/bad-name-2/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:00.631-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:00.641-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/bad-name-2 PASSED 2021-01-13T07:40:00.641-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/bad-name-2... 2021-01-13T07:40:00.664-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:00.803-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/bad-name-2 2021-01-13T07:40:00.803-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 35: external-dataset: common/include-exclude/bad-name-2] SUCCEEDED 2021-01-13T07:40:00.803-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 36: external-dataset: common/include-exclude/bad-name-3] START 2021-01-13T07:40:00.803-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/bad-name-3 ... 2021-01-13T07:40:00.844-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/bad-name-3/result.000.adm 2021-01-13T07:40:00.845-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:00.909-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/bad-name-3/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:00.909-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:00.928-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/bad-name-3 PASSED 2021-01-13T07:40:00.928-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/bad-name-3... 2021-01-13T07:40:00.951-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:01.089-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/bad-name-3 2021-01-13T07:40:01.089-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 36: external-dataset: common/include-exclude/bad-name-3] SUCCEEDED 2021-01-13T07:40:01.090-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 37: external-dataset: common/include-exclude/bad-name-4] START 2021-01-13T07:40:01.091-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/bad-name-4 ... 2021-01-13T07:40:01.110-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/bad-name-4/result.000.adm 2021-01-13T07:40:01.111-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:01.146-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/bad-name-4/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:01.146-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:01.161-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/bad-name-4 PASSED 2021-01-13T07:40:01.161-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/bad-name-4... 2021-01-13T07:40:01.188-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:01.326-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/bad-name-4 2021-01-13T07:40:01.327-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 37: external-dataset: common/include-exclude/bad-name-4] SUCCEEDED 2021-01-13T07:40:01.328-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 38: external-dataset: common/include-exclude/non-string] START 2021-01-13T07:40:01.329-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/non-string ... 2021-01-13T07:40:01.345-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/non-string/result.000.adm 2021-01-13T07:40:01.347-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:01.385-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/non-string/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:01.386-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:01.407-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/non-string PASSED 2021-01-13T07:40:01.407-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/non-string... 2021-01-13T07:40:01.434-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:01.595-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/non-string 2021-01-13T07:40:01.596-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 38: external-dataset: common/include-exclude/non-string] SUCCEEDED 2021-01-13T07:40:01.597-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 39: external-dataset: common/include-exclude/both] START 2021-01-13T07:40:01.597-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/both ... 2021-01-13T07:40:01.616-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/both/result.000.adm 2021-01-13T07:40:01.617-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:01.646-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/both/test.001.ddl.sqlpp raised an (expected) exception 2021-01-13T07:40:01.647-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:01.671-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/both PASSED 2021-01-13T07:40:01.671-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/both... 2021-01-13T07:40:01.710-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:01.898-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/both 2021-01-13T07:40:01.899-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 39: external-dataset: common/include-exclude/both] SUCCEEDED 2021-01-13T07:40:01.900-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 40: external-dataset: common/include-exclude/exclude-all] START 2021-01-13T07:40:01.900-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-all ... 2021-01-13T07:40:01.922-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-all/result.000.adm 2021-01-13T07:40:01.923-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:02.025-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-all/result.002.adm 2021-01-13T07:40:02.025-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:02.041-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-all PASSED 2021-01-13T07:40:02.042-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-all... 2021-01-13T07:40:02.081-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:02.169-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:02.282-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-all 2021-01-13T07:40:02.283-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 40: external-dataset: common/include-exclude/exclude-all] SUCCEEDED 2021-01-13T07:40:02.284-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 41: external-dataset: common/include-exclude/exclude-1] START 2021-01-13T07:40:02.284-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-1 ... 2021-01-13T07:40:02.303-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-1/result.000.adm 2021-01-13T07:40:02.304-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:02.461-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-1/result.002.adm 2021-01-13T07:40:02.462-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:02.482-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-1 PASSED 2021-01-13T07:40:02.483-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-1... 2021-01-13T07:40:02.519-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:02.595-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:02.696-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-1 2021-01-13T07:40:02.697-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 41: external-dataset: common/include-exclude/exclude-1] SUCCEEDED 2021-01-13T07:40:02.698-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 42: external-dataset: common/include-exclude/exclude-2] START 2021-01-13T07:40:02.698-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-2 ... 2021-01-13T07:40:02.718-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-2/result.000.adm 2021-01-13T07:40:02.719-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:02.825-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-2/result.002.adm 2021-01-13T07:40:02.825-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:02.836-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-2 PASSED 2021-01-13T07:40:02.837-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-2... 2021-01-13T07:40:02.865-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:02.938-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:03.048-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-2 2021-01-13T07:40:03.048-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 42: external-dataset: common/include-exclude/exclude-2] SUCCEEDED 2021-01-13T07:40:03.049-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 43: external-dataset: common/include-exclude/exclude-3] START 2021-01-13T07:40:03.049-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-3 ... 2021-01-13T07:40:03.076-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-3/result.000.adm 2021-01-13T07:40:03.076-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:03.189-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-3/result.002.adm 2021-01-13T07:40:03.190-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:03.201-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-3 PASSED 2021-01-13T07:40:03.201-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-3... 2021-01-13T07:40:03.224-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:03.286-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:03.372-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-3 2021-01-13T07:40:03.372-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 43: external-dataset: common/include-exclude/exclude-3] SUCCEEDED 2021-01-13T07:40:03.373-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 44: external-dataset: common/include-exclude/exclude-4] START 2021-01-13T07:40:03.373-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-4 ... 2021-01-13T07:40:03.393-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-4/result.000.adm 2021-01-13T07:40:03.393-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:03.496-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-4/result.002.adm 2021-01-13T07:40:03.496-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:03.510-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-4 PASSED 2021-01-13T07:40:03.510-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-4... 2021-01-13T07:40:03.534-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:03.606-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:03.690-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-4 2021-01-13T07:40:03.691-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 44: external-dataset: common/include-exclude/exclude-4] SUCCEEDED 2021-01-13T07:40:03.691-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 45: external-dataset: common/include-exclude/exclude-5] START 2021-01-13T07:40:03.691-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-5 ... 2021-01-13T07:40:03.713-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-5/result.000.adm 2021-01-13T07:40:03.713-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:03.878-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-5/result.002.adm 2021-01-13T07:40:03.879-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:03.890-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-5 PASSED 2021-01-13T07:40:03.890-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-5... 2021-01-13T07:40:03.917-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:03.981-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:04.071-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-5 2021-01-13T07:40:04.071-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 45: external-dataset: common/include-exclude/exclude-5] SUCCEEDED 2021-01-13T07:40:04.073-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 46: external-dataset: common/include-exclude/exclude-6] START 2021-01-13T07:40:04.073-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/exclude-6 ... 2021-01-13T07:40:04.089-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-6/result.000.adm 2021-01-13T07:40:04.090-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:04.244-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/exclude-6/result.002.adm 2021-01-13T07:40:04.244-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:04.262-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/exclude-6 PASSED 2021-01-13T07:40:04.262-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/exclude-6... 2021-01-13T07:40:04.286-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:04.375-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:04.462-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/exclude-6 2021-01-13T07:40:04.463-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 46: external-dataset: common/include-exclude/exclude-6] SUCCEEDED 2021-01-13T07:40:04.463-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 47: external-dataset: common/include-exclude/include-all] START 2021-01-13T07:40:04.463-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-all ... 2021-01-13T07:40:04.480-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-all/result.000.adm 2021-01-13T07:40:04.481-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:04.575-08:00 INFO TestExecutor [main] testFile ../cbas-cbserver-test/src/test/resources/runtimets/queries/external-dataset/common/include-exclude/include-all/test.002.query.sqlpp raised an (expected) exception 2021-01-13T07:40:04.575-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:04.587-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-all PASSED 2021-01-13T07:40:04.587-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-all... 2021-01-13T07:40:04.616-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:04.687-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:04.781-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-all 2021-01-13T07:40:04.781-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 47: external-dataset: common/include-exclude/include-all] SUCCEEDED 2021-01-13T07:40:04.782-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 48: external-dataset: common/include-exclude/include-1] START 2021-01-13T07:40:04.782-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-1 ... 2021-01-13T07:40:04.801-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-1/result.000.adm 2021-01-13T07:40:04.802-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:04.894-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-1/result.002.adm 2021-01-13T07:40:04.895-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:04.909-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-1 PASSED 2021-01-13T07:40:04.909-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-1... 2021-01-13T07:40:04.933-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:05.002-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:05.095-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-1 2021-01-13T07:40:05.096-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 48: external-dataset: common/include-exclude/include-1] SUCCEEDED 2021-01-13T07:40:05.096-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 49: external-dataset: common/include-exclude/include-2] START 2021-01-13T07:40:05.097-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-2 ... 2021-01-13T07:40:05.122-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-2/result.000.adm 2021-01-13T07:40:05.124-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:05.220-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-2/result.002.adm 2021-01-13T07:40:05.288-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-2/result.003.adm 2021-01-13T07:40:05.288-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:05.299-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-2 PASSED 2021-01-13T07:40:05.299-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-2... 2021-01-13T07:40:05.321-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:05.394-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:05.476-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-2 2021-01-13T07:40:05.476-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 49: external-dataset: common/include-exclude/include-2] SUCCEEDED 2021-01-13T07:40:05.476-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 50: external-dataset: common/include-exclude/include-3] START 2021-01-13T07:40:05.477-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-3 ... 2021-01-13T07:40:05.493-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-3/result.000.adm 2021-01-13T07:40:05.494-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:05.586-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-3/result.002.adm 2021-01-13T07:40:05.591-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:05.603-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-3 PASSED 2021-01-13T07:40:05.603-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-3... 2021-01-13T07:40:05.631-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:05.700-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:05.802-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-3 2021-01-13T07:40:05.803-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 50: external-dataset: common/include-exclude/include-3] SUCCEEDED 2021-01-13T07:40:05.803-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 51: external-dataset: common/include-exclude/include-4] START 2021-01-13T07:40:05.804-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-4 ... 2021-01-13T07:40:05.827-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-4/result.000.adm 2021-01-13T07:40:05.828-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:05.928-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-4/result.002.adm 2021-01-13T07:40:05.929-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:05.942-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-4 PASSED 2021-01-13T07:40:05.942-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-4... 2021-01-13T07:40:05.968-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:06.079-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:06.403-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-4 2021-01-13T07:40:06.403-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 51: external-dataset: common/include-exclude/include-4] SUCCEEDED 2021-01-13T07:40:06.404-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 52: external-dataset: common/include-exclude/include-5] START 2021-01-13T07:40:06.404-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-5 ... 2021-01-13T07:40:06.451-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-5/result.000.adm 2021-01-13T07:40:06.452-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:06.594-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-5/result.002.adm 2021-01-13T07:40:06.595-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:06.606-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-5 PASSED 2021-01-13T07:40:06.606-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-5... 2021-01-13T07:40:06.630-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:06.782-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:07.080-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-5 2021-01-13T07:40:07.080-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 52: external-dataset: common/include-exclude/include-5] SUCCEEDED 2021-01-13T07:40:07.080-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 53: external-dataset: common/include-exclude/include-6] START 2021-01-13T07:40:07.080-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-6 ... 2021-01-13T07:40:07.201-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-6/result.000.adm 2021-01-13T07:40:07.202-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:07.361-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-6/result.002.adm 2021-01-13T07:40:07.361-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:07.374-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-6 PASSED 2021-01-13T07:40:07.374-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-6... 2021-01-13T07:40:07.395-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:07.544-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:07.805-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-6 2021-01-13T07:40:07.805-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 53: external-dataset: common/include-exclude/include-6] SUCCEEDED 2021-01-13T07:40:07.807-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 54: external-dataset: common/include-exclude/include-7] START 2021-01-13T07:40:07.807-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-7 ... 2021-01-13T07:40:07.909-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-7/result.000.adm 2021-01-13T07:40:07.909-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:08.104-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-7/result.002.adm 2021-01-13T07:40:08.105-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:08.117-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-7 PASSED 2021-01-13T07:40:08.118-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-7... 2021-01-13T07:40:08.139-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:08.289-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:08.598-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-7 2021-01-13T07:40:08.598-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 54: external-dataset: common/include-exclude/include-7] SUCCEEDED 2021-01-13T07:40:08.599-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 55: external-dataset: common/include-exclude/include-8] START 2021-01-13T07:40:08.599-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-8 ... 2021-01-13T07:40:08.722-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-8/result.000.adm 2021-01-13T07:40:08.723-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:08.899-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-8/result.002.adm 2021-01-13T07:40:08.900-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:08.911-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-8 PASSED 2021-01-13T07:40:08.911-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-8... 2021-01-13T07:40:08.933-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:09.049-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:09.315-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-8 2021-01-13T07:40:09.315-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 55: external-dataset: common/include-exclude/include-8] SUCCEEDED 2021-01-13T07:40:09.316-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 56: external-dataset: common/include-exclude/include-9] START 2021-01-13T07:40:09.317-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-9 ... 2021-01-13T07:40:09.332-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-9/result.000.adm 2021-01-13T07:40:09.333-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:09.449-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-9/result.002.adm 2021-01-13T07:40:09.450-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:09.461-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-9 PASSED 2021-01-13T07:40:09.461-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-9... 2021-01-13T07:40:09.488-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:09.554-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:09.639-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-9 2021-01-13T07:40:09.639-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 56: external-dataset: common/include-exclude/include-9] SUCCEEDED 2021-01-13T07:40:09.640-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 57: external-dataset: common/include-exclude/include-10] START 2021-01-13T07:40:09.640-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-10 ... 2021-01-13T07:40:09.656-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-10/result.000.adm 2021-01-13T07:40:09.657-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:09.730-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-10/result.002.adm 2021-01-13T07:40:09.731-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:09.745-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-10 PASSED 2021-01-13T07:40:09.745-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-10... 2021-01-13T07:40:09.773-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:09.832-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:09.921-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-10 2021-01-13T07:40:09.922-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 57: external-dataset: common/include-exclude/include-10] SUCCEEDED 2021-01-13T07:40:09.922-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 58: external-dataset: common/include-exclude/include-11] START 2021-01-13T07:40:09.923-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-11 ... 2021-01-13T07:40:09.939-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-11/result.000.adm 2021-01-13T07:40:09.939-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:10.052-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-11/result.002.adm 2021-01-13T07:40:10.053-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:10.064-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-11 PASSED 2021-01-13T07:40:10.064-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-11... 2021-01-13T07:40:10.087-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:10.147-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:10.238-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-11 2021-01-13T07:40:10.238-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 58: external-dataset: common/include-exclude/include-11] SUCCEEDED 2021-01-13T07:40:10.239-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 59: external-dataset: common/include-exclude/include-12] START 2021-01-13T07:40:10.239-08:00 INFO TestExecutor [main] Starting [TEST]: external-dataset/common/include-exclude/include-12 ... 2021-01-13T07:40:10.256-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-12/result.000.adm 2021-01-13T07:40:10.257-08:00 INFO TestExecutor [main] Executing test file: test.001.ddl.sqlpp 2021-01-13T07:40:10.326-08:00 INFO TestExecutor [main] Expected results file: ../cbas-cbserver-test/src/test/resources/runtimets/results/external-dataset/common/include-exclude/include-12/result.002.adm 2021-01-13T07:40:10.327-08:00 INFO TestExecutor [main] Executing test file: test.099.ddl.sqlpp 2021-01-13T07:40:10.339-08:00 INFO TestExecutor [main] [TEST]: external-dataset/common/include-exclude/include-12 PASSED 2021-01-13T07:40:10.339-08:00 INFO TestExecutor [main] Cleaning up after test case external-dataset: common/include-exclude/include-12... 2021-01-13T07:40:10.363-08:00 INFO TestExecutor [main] Disconnecting link Default.Local 2021-01-13T07:40:10.427-08:00 INFO TestExecutor [main] Dropping dataset `Default`.`test` 2021-01-13T07:40:10.516-08:00 INFO TestExecutor [main] Clean up completed for test case external-dataset: common/include-exclude/include-12 2021-01-13T07:40:10.517-08:00 WARN TestMethodTracer [main] ### test[ClusterAzureBlobStorageExternalDatasetIT 59: external-dataset: common/include-exclude/include-12] SUCCEEDED 2021-01-13T07:40:10.520-08:00 INFO DockerTestBase [main] Copying files from docker container d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD/0002_cbas_thisbuild 2021-01-13T07:40:10.521-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD/0001_azurite_mcr.microsoft.com_azure-storage_azurite_3.8.0 2021-01-13T07:40:10.614-08:00 WARN DockerTestBase [ForkJoinPool.commonPool-worker-3] Error copying files from docker container: c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 com.github.dockerjava.api.exception.NotFoundException: Could not find the file /opt/couchbase/var/lib/couchbase/logs/ in container c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 at com.github.dockerjava.jaxrs.filter.ResponseStatusExceptionFilter.filter(ResponseStatusExceptionFilter.java:53) ~[docker-java-3.1.5.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:133) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:121) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.process.internal.Stages.process(Stages.java:171) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:283) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:316) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:298) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:229) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:419) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:319) ~[jersey-client-2.27.jar:?] at com.github.dockerjava.jaxrs.CopyArchiveFromContainerCmdExec.execute(CopyArchiveFromContainerCmdExec.java:32) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.CopyArchiveFromContainerCmdExec.execute(CopyArchiveFromContainerCmdExec.java:15) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:23) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.CopyArchiveFromContainerCmdImpl.exec(CopyArchiveFromContainerCmdImpl.java:70) ~[docker-java-3.1.5.jar:?] at com.couchbase.analytics.test.docker.DockerTestBase.copyFilesFromContainer(DockerTestBase.java:947) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.stopContainer(DockerTestBase.java:814) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.stopContainer(DockerTestBase.java:795) ~[test-classes/:?] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) [?:?] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655) [?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) [?:?] at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) [?:?] at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:746) [?:?] at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290) [?:?] at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020) [?:?] at java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656) [?:?] at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594) [?:?] at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) [?:?] 2021-01-13T07:40:10.624-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 2021-01-13T07:40:10.805-08:00 INFO DockerTestBase [main] Stopping docker container: d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9 2021-01-13T07:40:11.234-08:00 INFO DockerTestBase [main] Stopped docker container: d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9 2021-01-13T07:40:20.927-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 2021-01-13T07:40:20.929-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 2021-01-13T07:40:20.929-08:00 INFO DockerTestBase [main] Removing docker container: d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9 2021-01-13T07:40:20.941-08:00 INFO DockerTestBase [main] Removed docker container: d0e054112709d25ba3c6d0cee1fdc77f2f9fd4b7fcb0fb420fdf31864ee933e9 2021-01-13T07:40:20.945-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: c49e1ba0c9c9b42d51999da9799841f72ebcdc5945c43b99e0801aa5dd571920 2021-01-13T07:40:20.946-08:00 INFO DockerTestBase [main] Removing docker network: b77d1eb3d71ed5c45397386d4671049fc2ae90241d05d6bbf929ab3abc3a7681 2021-01-13T07:40:21.015-08:00 INFO DockerTestBase [main] Removed docker network: b77d1eb3d71ed5c45397386d4671049fc2ae90241d05d6bbf929ab3abc3a7681 [INFO] Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 164.495 s - in com.couchbase.analytics.test.docker.external.ClusterAzureBlobStorageExternalDatasetITD [INFO] Running com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD 2021-01-13 07:40:22,936 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:40:23.009-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:40:23.024-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:40:23.025-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:40:23.113-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.6.0 2021-01-13T07:40:25.392-08:00 INFO DockerTestBase [main+] >> enterprise-6.6.0: Pulling from library/couchbase 2021-01-13T07:40:27.025-08:00 INFO DockerTestBase [main+] >> be8ec4e48d7f: Pulling fs layer 2021-01-13T07:40:27.026-08:00 INFO DockerTestBase [main+] >> 33b8b485aff0: Pulling fs layer 2021-01-13T07:40:27.026-08:00 INFO DockerTestBase [main+] >> d887158cc58c: Pulling fs layer 2021-01-13T07:40:27.026-08:00 INFO DockerTestBase [main+] >> 05895bb28c18: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> 1b76493b3cae: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> 9bea28941a82: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> 0f0ec62baa1d: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> 04851d9a1696: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> d5fd6b8ecadc: Pulling fs layer 2021-01-13T07:40:27.027-08:00 INFO DockerTestBase [main+] >> 6729cd041048: Pulling fs layer 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> 13411c974d9c: Pulling fs layer 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> b55ff3370e31: Pulling fs layer 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> e3d5cd2db61d: Pulling fs layer 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> 76664d078e8f: Pulling fs layer 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> 05895bb28c18: Waiting 2021-01-13T07:40:27.028-08:00 INFO DockerTestBase [main+] >> 1b76493b3cae: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> 9bea28941a82: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> 0f0ec62baa1d: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> 04851d9a1696: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> d5fd6b8ecadc: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> 6729cd041048: Waiting 2021-01-13T07:40:27.029-08:00 INFO DockerTestBase [main+] >> 13411c974d9c: Waiting 2021-01-13T07:40:27.030-08:00 INFO DockerTestBase [main+] >> b55ff3370e31: Waiting 2021-01-13T07:40:27.030-08:00 INFO DockerTestBase [main+] >> e3d5cd2db61d: Waiting 2021-01-13T07:40:27.030-08:00 INFO DockerTestBase [main+] >> 76664d078e8f: Waiting 2021-01-13T07:40:27.417-08:00 INFO DockerTestBase [main+] >> d887158cc58c: Verifying Checksum 2021-01-13T07:40:27.418-08:00 INFO DockerTestBase [main+] >> d887158cc58c: Download complete 2021-01-13T07:40:27.423-08:00 INFO DockerTestBase [main+] >> 33b8b485aff0: Verifying Checksum 2021-01-13T07:40:27.424-08:00 INFO DockerTestBase [main+] >> 33b8b485aff0: Download complete 2021-01-13T07:40:27.775-08:00 INFO DockerTestBase [main+] >> 05895bb28c18: Verifying Checksum 2021-01-13T07:40:27.775-08:00 INFO DockerTestBase [main+] >> 05895bb28c18: Download complete 2021-01-13T07:40:28.148-08:00 INFO DockerTestBase [main+] >> 9bea28941a82: Verifying Checksum 2021-01-13T07:40:28.148-08:00 INFO DockerTestBase [main+] >> 9bea28941a82: Download complete 2021-01-13T07:40:28.150-08:00 INFO DockerTestBase [main+] >> 1b76493b3cae: Verifying Checksum 2021-01-13T07:40:28.150-08:00 INFO DockerTestBase [main+] >> 1b76493b3cae: Download complete 2021-01-13T07:40:28.609-08:00 INFO DockerTestBase [main+] >> 04851d9a1696: Verifying Checksum 2021-01-13T07:40:28.610-08:00 INFO DockerTestBase [main+] >> 04851d9a1696: Download complete 2021-01-13T07:40:28.955-08:00 INFO DockerTestBase [main+] >> be8ec4e48d7f: Verifying Checksum 2021-01-13T07:40:28.955-08:00 INFO DockerTestBase [main+] >> be8ec4e48d7f: Download complete 2021-01-13T07:40:28.965-08:00 INFO DockerTestBase [main+] >> d5fd6b8ecadc: Verifying Checksum 2021-01-13T07:40:28.966-08:00 INFO DockerTestBase [main+] >> d5fd6b8ecadc: Download complete 2021-01-13T07:40:29.303-08:00 INFO DockerTestBase [main+] >> 13411c974d9c: Verifying Checksum 2021-01-13T07:40:29.304-08:00 INFO DockerTestBase [main+] >> 13411c974d9c: Download complete 2021-01-13T07:40:29.320-08:00 INFO DockerTestBase [main+] >> 6729cd041048: Verifying Checksum 2021-01-13T07:40:29.320-08:00 INFO DockerTestBase [main+] >> 6729cd041048: Download complete 2021-01-13T07:40:29.644-08:00 INFO DockerTestBase [main+] >> b55ff3370e31: Verifying Checksum 2021-01-13T07:40:29.644-08:00 INFO DockerTestBase [main+] >> b55ff3370e31: Download complete 2021-01-13T07:40:29.723-08:00 INFO DockerTestBase [main+] >> e3d5cd2db61d: Verifying Checksum 2021-01-13T07:40:29.723-08:00 INFO DockerTestBase [main+] >> e3d5cd2db61d: Download complete 2021-01-13T07:40:29.994-08:00 INFO DockerTestBase [main+] >> 76664d078e8f: Verifying Checksum 2021-01-13T07:40:29.995-08:00 INFO DockerTestBase [main+] >> 76664d078e8f: Download complete 2021-01-13T07:40:31.261-08:00 INFO DockerTestBase [main+] >> be8ec4e48d7f: Pull complete 2021-01-13T07:40:31.372-08:00 INFO DockerTestBase [main+] >> 33b8b485aff0: Pull complete 2021-01-13T07:40:31.492-08:00 INFO DockerTestBase [main+] >> d887158cc58c: Pull complete 2021-01-13T07:40:31.592-08:00 INFO DockerTestBase [main+] >> 05895bb28c18: Pull complete 2021-01-13T07:40:32.179-08:00 INFO DockerTestBase [main+] >> 1b76493b3cae: Pull complete 2021-01-13T07:40:32.268-08:00 INFO DockerTestBase [main+] >> 9bea28941a82: Pull complete 2021-01-13T07:40:44.008-08:00 INFO DockerTestBase [main+] >> 0f0ec62baa1d: Verifying Checksum 2021-01-13T07:40:44.008-08:00 INFO DockerTestBase [main+] >> 0f0ec62baa1d: Download complete 2021-01-13T07:40:55.826-08:00 INFO DockerTestBase [main+] >> 0f0ec62baa1d: Pull complete 2021-01-13T07:40:55.928-08:00 INFO DockerTestBase [main+] >> 04851d9a1696: Pull complete 2021-01-13T07:40:56.028-08:00 INFO DockerTestBase [main+] >> d5fd6b8ecadc: Pull complete 2021-01-13T07:40:56.124-08:00 INFO DockerTestBase [main+] >> 6729cd041048: Pull complete 2021-01-13T07:40:56.212-08:00 INFO DockerTestBase [main+] >> 13411c974d9c: Pull complete 2021-01-13T07:40:56.313-08:00 INFO DockerTestBase [main+] >> b55ff3370e31: Pull complete 2021-01-13T07:40:56.416-08:00 INFO DockerTestBase [main+] >> e3d5cd2db61d: Pull complete 2021-01-13T07:40:56.513-08:00 INFO DockerTestBase [main+] >> 76664d078e8f: Pull complete 2021-01-13T07:40:56.519-08:00 INFO DockerTestBase [main+] >> Digest: sha256:7c2cb7b39d2b7e88d4885385bd996af5bbdf2cd39ee3d5725151aede8cc98f71 2021-01-13T07:40:56.521-08:00 INFO DockerTestBase [main+] >> Status: Downloaded newer image for couchbase:enterprise-6.6.0 2021-01-13T07:40:56.522-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.6.0 2021-01-13T07:40:56.530-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat START 2021-01-13T07:40:57.599-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887) 2021-01-13T07:40:57.678-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887, id = 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 } 2021-01-13T07:40:57.683-08:00 INFO UpgradeTestBase [pool] Creating n1 node ... 2021-01-13T07:40:57.686-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:40:57.691-08:00 INFO UpgradeTestBase [pool] Creating n2 node ... 2021-01-13T07:40:57.695-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:40:57.696-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887, id = 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 }) 2021-01-13T07:40:57.692-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887, id = 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 }) 2021-01-13T07:40:58.887-08:00 INFO DockerTestBase [pool] Container information for ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55806->192.168.176.2:8091, 172.17.0.1:55798->192.168.176.2:8095 2021-01-13T07:40:58.889-08:00 INFO DockerTestBase [pool] Container information for bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55810->192.168.176.3:8091, 172.17.0.1:55805->192.168.176.3:8095 2021-01-13T07:41:10.365-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:41:10.373-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:41:11.068-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:41:11.068-08:00 INFO DockerTestBase [pool] Executing the command: docker exec ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:41:11.987-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:41:12.212-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:41:12.242-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:41:12.242-08:00 INFO DockerTestBase [main] Executing the command: docker exec ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:41:12.630-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:41:12.665-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:41:25.043-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T07:41:25.044-08:00 INFO DockerTestBase [main] Executing the command: docker exec ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:41:27.941-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:41:27.979-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T07:41:27.980-08:00 INFO DockerTestBase [main] Executing the command: docker exec ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T07:41:35.384-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:41:35.385-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:41:35.417-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:41:35.426-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:41:35.426-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:41:35.524-08:00 INFO UpgradeTestBase [main] Creating S3 link... 2021-01-13T07:41:35.525-08:00 INFO DockerTestBase [main] Executing the command: docker exec bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 /opt/couchbase/bin/couchbase-cli analytics-link-setup -c 192.168.176.3 -u couchbase -p couchbase --create --dataverse Default --name myLink --type s3 --access-key-id dummyAccessKeyId --secret-access-key dummySecretAccessKey --region us-west-2 --service-endpoint http://localhost:8001 2021-01-13T07:41:35.967-08:00 INFO DockerTestBase [main+] >> SUCCESS: Link created 2021-01-13T07:41:35.991-08:00 INFO UpgradeTestBase [main] S3 link created successfully 2021-01-13T07:41:35.991-08:00 INFO UpgradeTestBase [main] Getting link details before upgrade... 2021-01-13T07:41:36.077-08:00 INFO UpgradeTestBase [main] Link details retrieved successfully 2021-01-13T07:41:36.077-08:00 INFO UpgradeTestBase [main] Upgrading n1.couchbase.host (online, rebalance) ... 2021-01-13T07:41:36.078-08:00 INFO UpgradeTestBase [main] Creating n1-new node using 'this build' docker image... 2021-01-13T07:41:36.079-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n1new to /opt/couchbase/var 2021-01-13T07:41:36.079-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:41:36.195-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:41:36.235-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:41:36.235-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:41:36.268-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:41:36.270-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild, network = { name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887, id = 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 }) 2021-01-13T07:41:37.472-08:00 INFO DockerTestBase [main] Container information for 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49: host: n1new.couchbase.host, ip: 192.168.176.4, 172.17.0.1:55825->192.168.176.4:8091, 172.17.0.1:55821->192.168.176.4:8095 2021-01-13T07:41:45.711-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1new (192.168.176.4) 2021-01-13T07:41:45.711-08:00 INFO DockerTestBase [main] Executing the command: docker exec 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n1new.couchbase.host 2021-01-13T07:41:46.836-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:41:46.863-08:00 INFO DockerTestBase [main] Running 'server-add' for node n1new (192.168.176.4) with services: [DATA, ANALYTICS] 2021-01-13T07:41:46.864-08:00 INFO DockerTestBase [main] Executing the command: docker exec bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://n1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data,analytics 2021-01-13T07:41:51.323-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:41:51.348-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T07:41:51.348-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T07:41:51.349-08:00 INFO DockerTestBase [main] Executing the command: docker exec bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove n1.couchbase.host 2021-01-13T07:42:12.463-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:42:12.464-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:42:12.497-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:42:12.505-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:42:12.505-08:00 INFO DockerTestBase [main] Copying files from docker container ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.6.0 2021-01-13T07:42:12.771-08:00 INFO DockerTestBase [main] Stopping docker container: ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f 2021-01-13T07:42:13.193-08:00 INFO DockerTestBase [main] Stopped docker container: ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f 2021-01-13T07:42:13.193-08:00 INFO DockerTestBase [main] Removing docker container: ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f 2021-01-13T07:42:13.209-08:00 INFO DockerTestBase [main] Removed docker container: ca69c154f4bc18d817bbe9a74bd0a86c42ee4b7df86b2cc5f35ab17e6358e87f 2021-01-13T07:42:13.210-08:00 INFO UpgradeTestBase [main] Upgrading n2.couchbase.host (online, rebalance) ... 2021-01-13T07:42:13.210-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T07:42:13.210-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n2new to /opt/couchbase/var 2021-01-13T07:42:13.211-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild, network = { name = cbas-docker-test-0001-4bd8aa6f-da5a-41b4-9337-82897d33b887, id = 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 }) 2021-01-13T07:42:14.292-08:00 INFO DockerTestBase [main] Container information for f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74: host: n2new.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55840->192.168.176.2:8091, 172.17.0.1:55836->192.168.176.2:8095 2021-01-13T07:42:25.484-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.2) 2021-01-13T07:42:25.484-08:00 INFO DockerTestBase [main] Executing the command: docker exec f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T07:42:27.040-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:42:27.082-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.2) with services: [ANALYTICS] 2021-01-13T07:42:27.083-08:00 INFO DockerTestBase [main] Executing the command: docker exec 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:42:31.007-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:42:31.056-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T07:42:31.056-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T07:42:31.056-08:00 INFO DockerTestBase [main] Executing the command: docker exec 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host 2021-01-13T07:42:41.587-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:42:41.588-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:42:41.662-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:42:41.675-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:42:41.675-08:00 INFO DockerTestBase [main] Copying files from docker container bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.6.0 2021-01-13T07:42:41.939-08:00 INFO DockerTestBase [main] Stopping docker container: bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 2021-01-13T07:42:42.519-08:00 INFO DockerTestBase [main] Stopped docker container: bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 2021-01-13T07:42:42.520-08:00 INFO DockerTestBase [main] Removing docker container: bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 2021-01-13T07:42:42.569-08:00 INFO DockerTestBase [main] Removed docker container: bcb5e36aa68d259eca085d0a204766932da5a3e0f542c15649df2fd2053aebe1 2021-01-13T07:42:42.569-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:43:02.698-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T07:43:02.878-08:00 INFO UpgradeTestBase [main] Getting link details after upgrade... 2021-01-13T07:43:03.000-08:00 INFO UpgradeTestBase [main] Link details retrieved successfully 2021-01-13T07:43:03.005-08:00 INFO DockerTestBase [main] Copying files from docker container f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild 2021-01-13T07:43:03.005-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild 2021-01-13T07:43:03.305-08:00 INFO DockerTestBase [main] Stopping docker container: f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74 2021-01-13T07:43:03.388-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 2021-01-13T07:43:03.783-08:00 INFO DockerTestBase [main] Stopped docker container: f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74 2021-01-13T07:43:03.898-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 2021-01-13T07:43:03.900-08:00 INFO DockerTestBase [main] Removing docker container: f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74 2021-01-13T07:43:03.900-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 2021-01-13T07:43:03.921-08:00 INFO DockerTestBase [main] Removed docker container: f2cd6bcbfbb69bb3fb234a05ea5b90d166cf5ae9439909101fdadbd710885c74 2021-01-13T07:43:03.923-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 0cd30aeacd74a822b8f81c46d7960e8ab910546f9ff0cccaf4fe684ab90ead49 2021-01-13T07:43:03.925-08:00 INFO DockerTestBase [main] Removing docker network: 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 2021-01-13T07:43:03.989-08:00 INFO DockerTestBase [main] Removed docker network: 21a257cecd7c779d6f5d631b3d750f82dcef9c5b0556a60b5f46f659c09d5eb0 2021-01-13T07:43:03.998-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 162.112 s - in com.couchbase.analytics.test.docker.external.S3LinkUpgradeFrom660ITD [INFO] Running com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD 2021-01-13 07:43:06,436 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:43:06.572-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:43:06.600-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:43:06.601-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:43:06.671-08:00 WARN TestMethodTracer [main] ### refreshCcIpAddress START 2021-01-13T07:43:08.114-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-20de1d2a-2c77-4089-8c91-1d7bdca7c6c3) 2021-01-13T07:43:08.218-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-20de1d2a-2c77-4089-8c91-1d7bdca7c6c3, id = fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 } 2021-01-13T07:43:08.225-08:00 INFO UpgradeTestBase [pool] Creating n1 node using 'this build' docker image... 2021-01-13T07:43:08.230-08:00 INFO UpgradeTestBase [pool] Creating n2 node using 'this build' docker image... 2021-01-13T07:43:08.231-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:43:08.231-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:43:08.241-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:43:08.326-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:43:08.331-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:43:08.332-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:43:08.337-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:43:08.340-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0002_n1_thisbuild, network = { name = cbas-docker-test-0001-20de1d2a-2c77-4089-8c91-1d7bdca7c6c3, id = fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 }) 2021-01-13T07:43:08.347-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0001_n2_thisbuild, network = { name = cbas-docker-test-0001-20de1d2a-2c77-4089-8c91-1d7bdca7c6c3, id = fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 }) 2021-01-13T07:43:09.878-08:00 INFO DockerTestBase [pool] Container information for f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55868->192.168.176.2:8091, 172.17.0.1:55860->192.168.176.2:8095 2021-01-13T07:43:09.875-08:00 INFO DockerTestBase [pool] Container information for 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55870->192.168.176.3:8091, 172.17.0.1:55863->192.168.176.3:8095 2021-01-13T07:43:19.152-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:43:19.155-08:00 INFO DockerTestBase [pool] Executing the command: docker exec f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:43:20.129-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:43:20.130-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:43:20.887-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:43:21.280-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:43:21.333-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:43:21.335-08:00 INFO DockerTestBase [main] Executing the command: docker exec f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:43:21.816-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:43:21.867-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T07:43:21.868-08:00 INFO DockerTestBase [main] Executing the command: docker exec f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:43:26.513-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:43:26.547-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T07:43:26.548-08:00 INFO DockerTestBase [main] Executing the command: docker exec f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T07:43:41.117-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:43:41.117-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:43:41.160-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:43:41.170-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:43:41.180-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:43:41.344-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55868] 2021-01-13T07:43:41.347-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:55868 2021-01-13T07:43:42.416-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55870] 2021-01-13T07:43:46.782-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:43:46.785-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:43:48.201-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 359 } 2021-01-13T07:43:48.211-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 359 } 2021-01-13T07:43:49.213-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:43:49.565-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2955 } 2021-01-13T07:43:49.566-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2955 } 2021-01-13T07:43:50.567-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:43:50.748-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:43:50.749-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:43:50.749-08:00 INFO UpgradeTestBase [main] Recreating 'n1' node (image = null, forceNewIp = true)... 2021-01-13T07:43:50.750-08:00 INFO DockerTestBase [main] Copying files from docker container f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0002_n1_thisbuild 2021-01-13T07:43:51.092-08:00 INFO DockerTestBase [main] Stopping docker container: f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c 2021-01-13T07:43:51.569-08:00 INFO DockerTestBase [main] Stopped docker container: f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c 2021-01-13T07:43:51.570-08:00 INFO DockerTestBase [main] Removing docker container: f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c 2021-01-13T07:43:51.582-08:00 INFO DockerTestBase [main] Removed docker container: f3c1fb9a5f37c330689964f0d2cd93fdd11453a00dbd9a77baf7d1e43f873f6c 2021-01-13T07:43:51.585-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0003_n1_thisbuild, network = { name = cbas-docker-test-0001-20de1d2a-2c77-4089-8c91-1d7bdca7c6c3, id = fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 }) 2021-01-13T07:43:52.458-08:00 INFO DockerTestBase [main] Container information for c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196: host: n1.couchbase.host, ip: 192.168.178.0, 172.17.0.1:55885->192.168.178.0:8091, 172.17.0.1:55881->192.168.178.0:8095 2021-01-13T07:44:00.502-08:00 INFO IpAddressRefreshITD [main] waiting to 4 minutes for IPs to refresh in the NC container & cluster to be active 2021-01-13T07:44:00.506-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 240s... 2021-01-13T07:44:00.506-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 240s... 2021-01-13T07:45:03.713-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55885] 2021-01-13T07:45:03.713-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55870] 2021-01-13T07:45:03.714-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T07:45:03.714-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:45:03.715-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:45:04.452-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2942 } 2021-01-13T07:45:04.452-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 2942 } 2021-01-13T07:45:04.518-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2942 } 2021-01-13T07:45:04.518-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 1. ResultSet found : { "$1": 2942 } 2021-01-13T07:45:05.453-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:05.520-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:05.737-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2942 } 2021-01-13T07:45:05.738-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2942 } 2021-01-13T07:45:05.858-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2942 } 2021-01-13T07:45:05.858-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 2. ResultSet found : { "$1": 2942 } 2021-01-13T07:45:06.859-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:07.323-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 251 } 2021-01-13T07:45:07.324-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 251 } 2021-01-13T07:45:07.385-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 334 } 2021-01-13T07:45:07.385-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 3. ResultSet found : { "$1": 334 } 2021-01-13T07:45:08.325-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:08.386-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:08.703-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1987 } 2021-01-13T07:45:08.704-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 1987 } 2021-01-13T07:45:08.874-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2122 } 2021-01-13T07:45:08.874-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 4. ResultSet found : { "$1": 2122 } 2021-01-13T07:45:09.876-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:09.928-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:09.928-08:00 INFO DockerTestBase [main] Failed attempt number: 5. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:10.062-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:10.063-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 5. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:10.929-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:11.057-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:11.058-08:00 INFO DockerTestBase [main] Failed attempt number: 6. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:11.064-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:11.212-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:11.213-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 6. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:12.166-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:12.166-08:00 INFO DockerTestBase [main] Failed attempt number: 7. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:12.214-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:12.340-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:12.342-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 7. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:13.167-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:13.272-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:13.272-08:00 INFO DockerTestBase [main] Failed attempt number: 8. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:13.343-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:13.450-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:13.450-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 8. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:14.381-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:14.381-08:00 INFO DockerTestBase [main] Failed attempt number: 9. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:14.451-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:14.532-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:14.532-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 9. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:15.382-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:15.488-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:15.488-08:00 INFO DockerTestBase [main] Failed attempt number: 10. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:15.533-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:15.658-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:15.659-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 10. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:16.592-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:16.592-08:00 INFO DockerTestBase [main] Failed attempt number: 11. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:16.660-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:16.724-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:16.724-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 11. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:17.594-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:17.671-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:17.672-08:00 INFO DockerTestBase [main] Failed attempt number: 12. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:17.725-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:17.824-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:17.824-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 12. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:18.752-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:18.752-08:00 INFO DockerTestBase [main] Failed attempt number: 13. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:18.825-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:18.902-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:18.903-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 13. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:19.753-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:19.823-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:19.823-08:00 INFO DockerTestBase [main] Failed attempt number: 14. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:19.904-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:19.972-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:19.973-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 14. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:20.914-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:20.915-08:00 INFO DockerTestBase [main] Failed attempt number: 15. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:20.974-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:21.090-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:21.090-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 15. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:21.916-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:22.023-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:22.024-08:00 INFO DockerTestBase [main] Failed attempt number: 16. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:22.091-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:22.192-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:22.193-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 16. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:23.111-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:23.111-08:00 INFO DockerTestBase [main] Failed attempt number: 17. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:23.194-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:23.278-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:23.279-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 17. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:24.112-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:24.192-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:24.193-08:00 INFO DockerTestBase [main] Failed attempt number: 18. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:24.280-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:24.368-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:24.369-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 18. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:25.271-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:25.271-08:00 INFO DockerTestBase [main] Failed attempt number: 19. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:25.370-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:25.460-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:25.460-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 19. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:26.272-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:26.363-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:26.363-08:00 INFO DockerTestBase [main] Failed attempt number: 20. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:26.461-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:26.533-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:26.533-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 20. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:27.426-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:27.426-08:00 INFO DockerTestBase [main] Failed attempt number: 21. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:27.534-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:27.604-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:27.604-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 21. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:28.428-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:28.498-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:28.499-08:00 INFO DockerTestBase [main] Failed attempt number: 22. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:28.605-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:28.698-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:28.698-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 22. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:29.583-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:29.584-08:00 INFO DockerTestBase [main] Failed attempt number: 23. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:29.699-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:29.756-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:29.757-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 23. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:30.585-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:30.669-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:30.670-08:00 INFO DockerTestBase [main] Failed attempt number: 24. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:30.758-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:30.822-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:30.823-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 24. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:31.784-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:31.784-08:00 INFO DockerTestBase [main] Failed attempt number: 25. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:31.823-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:31.893-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:31.893-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 25. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:32.785-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:32.842-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:32.842-08:00 INFO DockerTestBase [main] Failed attempt number: 26. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:32.894-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:32.986-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:32.986-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 26. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:33.890-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:33.891-08:00 INFO DockerTestBase [main] Failed attempt number: 27. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:33.987-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:34.060-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:34.063-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 27. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:34.892-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:34.958-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:34.958-08:00 INFO DockerTestBase [main] Failed attempt number: 28. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:35.064-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:35.113-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:35.113-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 28. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:36.023-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:36.024-08:00 INFO DockerTestBase [main] Failed attempt number: 29. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:36.114-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:36.174-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:36.175-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 29. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:37.024-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:37.090-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:37.090-08:00 INFO DockerTestBase [main] Failed attempt number: 30. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:37.176-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:37.235-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:37.235-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 30. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:38.153-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:38.153-08:00 INFO DockerTestBase [main] Failed attempt number: 31. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:38.236-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:38.338-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:38.338-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 31. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:39.154-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:39.215-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:39.216-08:00 INFO DockerTestBase [main] Failed attempt number: 32. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:39.339-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:39.403-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:39.404-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 32. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:40.283-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:40.283-08:00 INFO DockerTestBase [main] Failed attempt number: 33. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:40.404-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:40.452-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:40.453-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 33. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:41.284-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:41.356-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:41.357-08:00 INFO DockerTestBase [main] Failed attempt number: 34. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:41.453-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:41.503-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:41.504-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 34. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:42.421-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:42.421-08:00 INFO DockerTestBase [main] Failed attempt number: 35. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:42.504-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:42.562-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:42.563-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 35. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:43.422-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:43.471-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:43.471-08:00 INFO DockerTestBase [main] Failed attempt number: 36. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:43.564-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:43.610-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:43.611-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 36. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:44.526-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:44.526-08:00 INFO DockerTestBase [main] Failed attempt number: 37. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:44.612-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:44.662-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:44.662-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 37. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:45.527-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:45.580-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:45.581-08:00 INFO DockerTestBase [main] Failed attempt number: 38. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:45.663-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:45.718-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:45.719-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 38. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:46.650-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:46.651-08:00 INFO DockerTestBase [main] Failed attempt number: 39. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:46.720-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:46.776-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:46.776-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 39. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:47.652-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:47.702-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:47.702-08:00 INFO DockerTestBase [main] Failed attempt number: 40. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:47.777-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:47.834-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:47.835-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 40. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:48.762-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:48.762-08:00 INFO DockerTestBase [main] Failed attempt number: 41. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:48.836-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:48.882-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:48.882-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 41. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:49.763-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:49.813-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:49.813-08:00 INFO DockerTestBase [main] Failed attempt number: 42. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:49.883-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:49.929-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:49.929-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 42. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:50.864-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:50.865-08:00 INFO DockerTestBase [main] Failed attempt number: 43. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:50.930-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:50.983-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:50.984-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 43. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:51.865-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:51.913-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:51.913-08:00 INFO DockerTestBase [main] Failed attempt number: 44. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:51.984-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:52.033-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:52.033-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 44. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:52.971-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:52.971-08:00 INFO DockerTestBase [main] Failed attempt number: 45. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:53.034-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:53.086-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:53.086-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 45. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:53.972-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:54.039-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:54.040-08:00 INFO DockerTestBase [main] Failed attempt number: 46. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:54.087-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:54.134-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:54.135-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 46. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:55.092-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:55.092-08:00 INFO DockerTestBase [main] Failed attempt number: 47. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:55.135-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:55.186-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:55.187-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 47. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:56.093-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:56.140-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:56.140-08:00 INFO DockerTestBase [main] Failed attempt number: 48. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:56.187-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:56.234-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:56.235-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 48. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:57.185-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:57.185-08:00 INFO DockerTestBase [main] Failed attempt number: 49. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:57.235-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:57.278-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:57.278-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 49. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:58.186-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:45:58.237-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:58.237-08:00 INFO DockerTestBase [main] Failed attempt number: 50. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:58.279-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:45:58.330-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:58.330-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 50. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:59.314-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:59.314-08:00 INFO DockerTestBase [main] Failed attempt number: 51. ResultSet found : { "$1": 3911 } 2021-01-13T07:45:59.331-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:45:59.385-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:45:59.386-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 51. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:00.315-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:00.375-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:00.375-08:00 INFO DockerTestBase [main] Failed attempt number: 52. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:00.386-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:00.432-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:00.432-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 52. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:01.427-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:01.427-08:00 INFO DockerTestBase [main] Failed attempt number: 53. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:01.433-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:01.480-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:01.481-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 53. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:02.428-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:02.478-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:02.478-08:00 INFO DockerTestBase [main] Failed attempt number: 54. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:02.481-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:02.533-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:02.533-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 54. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:03.523-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:03.523-08:00 INFO DockerTestBase [main] Failed attempt number: 55. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:03.534-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:03.581-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:03.581-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 55. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:04.524-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:04.582-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:04.585-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:04.585-08:00 INFO DockerTestBase [main] Failed attempt number: 56. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:04.629-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:04.630-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 56. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:05.630-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:05.635-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:05.635-08:00 INFO DockerTestBase [main] Failed attempt number: 57. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:05.692-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:05.692-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 57. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:06.636-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:06.685-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:06.685-08:00 INFO DockerTestBase [main] Failed attempt number: 58. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:06.693-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:06.761-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:06.762-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 58. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:07.732-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:07.732-08:00 INFO DockerTestBase [main] Failed attempt number: 59. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:07.763-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:07.810-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:07.810-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 59. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:08.733-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:08.808-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:08.808-08:00 INFO DockerTestBase [main] Failed attempt number: 60. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:08.811-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:08.853-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:08.853-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 60. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:09.854-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:09.859-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:09.859-08:00 INFO DockerTestBase [main] Failed attempt number: 61. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:09.899-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:09.899-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 61. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:10.860-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:10.900-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:10.921-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:10.921-08:00 INFO DockerTestBase [main] Failed attempt number: 62. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:10.963-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:10.963-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 62. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:11.964-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:11.978-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:11.978-08:00 INFO DockerTestBase [main] Failed attempt number: 63. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:12.015-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:12.015-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 63. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:12.979-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:13.016-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:13.036-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:13.036-08:00 INFO DockerTestBase [main] Failed attempt number: 64. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:13.069-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:13.069-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 64. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:14.070-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:14.087-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:14.087-08:00 INFO DockerTestBase [main] Failed attempt number: 65. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:14.124-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:14.124-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 65. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:15.088-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:15.125-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:15.155-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:15.155-08:00 INFO DockerTestBase [main] Failed attempt number: 66. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:15.198-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:15.198-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 66. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:16.198-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:16.227-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:16.227-08:00 INFO DockerTestBase [main] Failed attempt number: 67. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:16.271-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:16.272-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 67. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:17.228-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:17.272-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:17.287-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:17.287-08:00 INFO DockerTestBase [main] Failed attempt number: 68. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:17.334-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:17.335-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 68. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:18.333-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:18.333-08:00 INFO DockerTestBase [main] Failed attempt number: 69. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:18.335-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:18.408-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:18.408-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 69. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:19.334-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:19.397-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:19.397-08:00 INFO DockerTestBase [main] Failed attempt number: 70. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:19.409-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:19.455-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:19.455-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 70. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:20.445-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:20.446-08:00 INFO DockerTestBase [main] Failed attempt number: 71. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:20.456-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:20.509-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:20.510-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 71. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:21.446-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:21.488-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:21.488-08:00 INFO DockerTestBase [main] Failed attempt number: 72. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:21.510-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:21.558-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:21.558-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 72. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:22.538-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:22.538-08:00 INFO DockerTestBase [main] Failed attempt number: 73. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:22.559-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:22.603-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:22.603-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 73. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:23.539-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:23.582-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:23.582-08:00 INFO DockerTestBase [main] Failed attempt number: 74. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:23.604-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:23.680-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:23.680-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 74. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:24.629-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:24.630-08:00 INFO DockerTestBase [main] Failed attempt number: 75. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:24.681-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:24.727-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:24.727-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 75. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:25.630-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:25.685-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:25.685-08:00 INFO DockerTestBase [main] Failed attempt number: 76. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:25.729-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:25.782-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:25.782-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 76. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:26.738-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:26.739-08:00 INFO DockerTestBase [main] Failed attempt number: 77. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:26.783-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:26.858-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:26.859-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 77. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:27.739-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:27.790-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:27.790-08:00 INFO DockerTestBase [main] Failed attempt number: 78. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:27.860-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:27.905-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:27.905-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 78. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:28.839-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:28.840-08:00 INFO DockerTestBase [main] Failed attempt number: 79. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:28.906-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:28.959-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:28.960-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 79. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:29.840-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:29.884-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:29.884-08:00 INFO DockerTestBase [main] Failed attempt number: 80. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:29.961-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:30.014-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:30.015-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 80. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:30.946-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:30.947-08:00 INFO DockerTestBase [main] Failed attempt number: 81. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:31.016-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:31.075-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:31.076-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 81. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:31.948-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:32.001-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:32.002-08:00 INFO DockerTestBase [main] Failed attempt number: 82. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:32.077-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:32.135-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:32.136-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 82. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:33.053-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:33.053-08:00 INFO DockerTestBase [main] Failed attempt number: 83. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:33.137-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:33.182-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:33.183-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 83. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:34.054-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:34.098-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:34.098-08:00 INFO DockerTestBase [main] Failed attempt number: 84. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:34.183-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:34.220-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:34.221-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 84. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:35.159-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:35.159-08:00 INFO DockerTestBase [main] Failed attempt number: 85. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:35.221-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:35.284-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:35.284-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 85. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:36.159-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:36.209-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:36.210-08:00 INFO DockerTestBase [main] Failed attempt number: 86. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:36.285-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:36.334-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:36.334-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 86. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:37.257-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:37.257-08:00 INFO DockerTestBase [main] Failed attempt number: 87. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:37.335-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:37.399-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:37.400-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 87. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:38.258-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:38.310-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:38.310-08:00 INFO DockerTestBase [main] Failed attempt number: 88. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:38.401-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:38.447-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:38.448-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 88. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:39.379-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:39.380-08:00 INFO DockerTestBase [main] Failed attempt number: 89. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:39.449-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:39.495-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:39.496-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 89. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:40.380-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:40.423-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:40.423-08:00 INFO DockerTestBase [main] Failed attempt number: 90. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:40.497-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:40.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:40.542-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 90. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:41.479-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:41.479-08:00 INFO DockerTestBase [main] Failed attempt number: 91. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:41.542-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:41.596-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:41.597-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 91. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:42.480-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:42.524-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:42.524-08:00 INFO DockerTestBase [main] Failed attempt number: 92. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:42.597-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:42.639-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:42.640-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 92. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:43.571-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:43.571-08:00 INFO DockerTestBase [main] Failed attempt number: 93. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:43.641-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:43.689-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:43.690-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 93. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:44.572-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:44.618-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:44.619-08:00 INFO DockerTestBase [main] Failed attempt number: 94. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:44.691-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:44.734-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:44.734-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 94. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:45.672-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:45.673-08:00 INFO DockerTestBase [main] Failed attempt number: 95. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:45.735-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:45.776-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:45.776-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 95. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:46.673-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:46.717-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:46.717-08:00 INFO DockerTestBase [main] Failed attempt number: 96. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:46.776-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:46.832-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:46.833-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 96. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:47.768-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:47.768-08:00 INFO DockerTestBase [main] Failed attempt number: 97. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:47.833-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:47.881-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:47.881-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 97. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:48.769-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:48.811-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:48.812-08:00 INFO DockerTestBase [main] Failed attempt number: 98. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:48.882-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:48.942-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:48.942-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 98. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:49.856-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:49.857-08:00 INFO DockerTestBase [main] Failed attempt number: 99. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:49.943-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:49.988-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:49.988-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 99. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:50.857-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:50.904-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:50.904-08:00 INFO DockerTestBase [main] Failed attempt number: 100. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:50.988-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:51.026-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:51.026-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 100. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:51.947-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:51.947-08:00 INFO DockerTestBase [main] Failed attempt number: 101. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:52.027-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:52.065-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:52.066-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 101. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:52.948-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:52.988-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:52.988-08:00 INFO DockerTestBase [main] Failed attempt number: 102. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:53.067-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:53.117-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:53.117-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 102. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:54.033-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:54.033-08:00 INFO DockerTestBase [main] Failed attempt number: 103. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:54.118-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:54.167-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:54.167-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 103. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:55.034-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:55.084-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:55.085-08:00 INFO DockerTestBase [main] Failed attempt number: 104. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:55.167-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:55.206-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:55.206-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 104. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:56.128-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:56.128-08:00 INFO DockerTestBase [main] Failed attempt number: 105. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:56.207-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:56.244-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:56.245-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 105. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:57.129-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:57.173-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:57.173-08:00 INFO DockerTestBase [main] Failed attempt number: 106. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:57.245-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:57.310-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:57.310-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 106. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:58.221-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:58.222-08:00 INFO DockerTestBase [main] Failed attempt number: 107. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:58.310-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:46:58.351-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:58.351-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 107. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:59.222-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:46:59.261-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:59.261-08:00 INFO DockerTestBase [main] Failed attempt number: 108. ResultSet found : { "$1": 3911 } 2021-01-13T07:46:59.352-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:46:59.400-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:46:59.400-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 108. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:00.321-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:00.321-08:00 INFO DockerTestBase [main] Failed attempt number: 109. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:00.401-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:00.460-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:00.460-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 109. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:01.322-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:01.365-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:01.365-08:00 INFO DockerTestBase [main] Failed attempt number: 110. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:01.461-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:01.504-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:01.504-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 110. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:02.425-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:02.425-08:00 INFO DockerTestBase [main] Failed attempt number: 111. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:02.505-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:02.540-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:02.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 111. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:03.426-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:03.467-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:03.467-08:00 INFO DockerTestBase [main] Failed attempt number: 112. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:03.541-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:03.588-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:03.588-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 112. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:04.511-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:04.511-08:00 INFO DockerTestBase [main] Failed attempt number: 113. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:04.589-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:04.627-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:04.628-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 113. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:05.511-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:05.558-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:05.558-08:00 INFO DockerTestBase [main] Failed attempt number: 114. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:05.628-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:05.666-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:05.666-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 114. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:06.600-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:06.600-08:00 INFO DockerTestBase [main] Failed attempt number: 115. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:06.666-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:06.711-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:06.711-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 115. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:07.601-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:07.649-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:07.649-08:00 INFO DockerTestBase [main] Failed attempt number: 116. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:07.712-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:07.753-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:07.754-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 116. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:08.689-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:08.689-08:00 INFO DockerTestBase [main] Failed attempt number: 117. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:08.754-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:08.798-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:08.798-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 117. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:09.690-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:09.733-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:09.734-08:00 INFO DockerTestBase [main] Failed attempt number: 118. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:09.799-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:09.840-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:09.840-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 118. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:10.778-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:10.778-08:00 INFO DockerTestBase [main] Failed attempt number: 119. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:10.840-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T07:47:10.882-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:10.882-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 119. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:11.779-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:47:11.835-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:11.835-08:00 INFO DockerTestBase [main] Failed attempt number: 120. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:11.882-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T07:47:11.915-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3911 } 2021-01-13T07:47:11.915-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 120. ResultSet found : { "$1": 3911 } 2021-01-13T07:47:12.838-08:00 INFO DockerTestBase [main] Taking cbcollect_info from n1 (192.168.178.0) 2021-01-13T07:47:12.838-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Taking cbcollect_info from n2 (192.168.176.3) 2021-01-13T07:47:12.838-08:00 INFO DockerTestBase [main] Executing the command: docker exec c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-13T07:47:12.839-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Executing the command: docker exec 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-13T07:47:13.004-08:00 INFO DockerTestBase [main+] >> 0 2021-01-13T07:47:13.004-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5+] >> 0 2021-01-13T07:47:13.014-08:00 INFO DockerTestBase [main] Executing the command: docker exec c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-13T07:47:13.016-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Executing the command: docker exec 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-13T07:48:59.870-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Finished taking cbcollect_info from n2 (192.168.176.3) 2021-01-13T07:48:59.871-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0001_n2_thisbuild 2021-01-13T07:49:00.389-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a 2021-01-13T07:49:00.991-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a 2021-01-13T07:49:34.726-08:00 INFO DockerTestBase [main] Finished taking cbcollect_info from n1 (192.168.178.0) 2021-01-13T07:49:34.726-08:00 INFO DockerTestBase [main] Copying files from docker container c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshCcIpAddress/0003_n1_thisbuild 2021-01-13T07:49:35.396-08:00 INFO DockerTestBase [main] Stopping docker container: c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 2021-01-13T07:49:35.850-08:00 INFO DockerTestBase [main] Stopped docker container: c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 2021-01-13T07:49:35.851-08:00 INFO DockerTestBase [main] Removing docker container: c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 2021-01-13T07:49:35.851-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a 2021-01-13T07:49:35.861-08:00 INFO DockerTestBase [main] Removed docker container: c038c3cd5f4fb3b767affd7ee15edbf561892d86fc60eca5c093969f7d474196 2021-01-13T07:49:35.864-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 78d36db9414346a752472051195d84bf8f8e8d535f19da78ee34f9905305f30a 2021-01-13T07:49:35.866-08:00 INFO DockerTestBase [main] Removing docker network: fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 2021-01-13T07:49:35.934-08:00 INFO DockerTestBase [main] Removed docker network: fb9eef58fb97cf625cc438d0c8ed9173637397f834fa97b440519099447c3748 2021-01-13T07:49:35.941-08:00 WARN TestMethodTracer [main] ### refreshCcIpAddress FAILED java.lang.AssertionError: Expected result to be { "$1": 5891 } but last result acquired = { "$1": 3911 } at org.junit.Assert.fail(Assert.java:89) ~[junit-4.13.jar:4.13] at com.couchbase.analytics.test.common.ClusterTestBase.pollQuery(ClusterTestBase.java:1192) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at com.couchbase.analytics.test.common.ClusterTestBase.pollQuery(ClusterTestBase.java:1171) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at com.couchbase.analytics.test.common.ClusterTestBase.waitForAllBeers(ClusterTestBase.java:1208) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at com.couchbase.analytics.test.docker.upgrade.UpgradeTestBase.waitForAllBeers(UpgradeTestBase.java:106) ~[test-classes/:?] at com.couchbase.analytics.test.docker.upgrade.UpgradeTestBase.lambda$verifyCbasAllBeers$2(UpgradeTestBase.java:123) ~[test-classes/:?] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) ~[?:?] at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?] at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) ~[?:?] at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:746) ~[?:?] at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290) ~[?:?] at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:408) ~[?:?] at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:736) ~[?:?] at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159) ~[?:?] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) ~[?:?] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497) ~[?:?] at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:661) ~[?:?] at com.couchbase.analytics.test.docker.upgrade.UpgradeTestBase.verifyCbasAllBeers(UpgradeTestBase.java:121) ~[test-classes/:?] at com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD.refreshCcIpAddress(IpAddressRefreshITD.java:37) ~[test-classes/:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) ~[junit-4.13.jar:4.13] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) ~[junit-4.13.jar:4.13] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) ~[junit-4.13.jar:4.13] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) ~[junit-4.13.jar:4.13] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) ~[junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) ~[junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) ~[junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) [junit-4.13.jar:4.13] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.run(ParentRunner.java:413) [junit-4.13.jar:4.13] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) [surefire-booter-2.21.0.jar:2.21.0] 2021-01-13T07:49:35.953-08:00 WARN TestMethodTracer [main] ### refreshNcIpAddress START 2021-01-13T07:49:36.042-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0002-c5316380-20fe-4f92-b265-1d82ec106385) 2021-01-13T07:49:36.095-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0002-c5316380-20fe-4f92-b265-1d82ec106385, id = 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 } 2021-01-13T07:49:36.097-08:00 INFO UpgradeTestBase [pool] Creating n1 node using 'this build' docker image... 2021-01-13T07:49:36.100-08:00 INFO UpgradeTestBase [pool] Creating n2 node using 'this build' docker image... 2021-01-13T07:49:36.136-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:49:36.137-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0004_n2_thisbuild, network = { name = cbas-docker-test-0002-c5316380-20fe-4f92-b265-1d82ec106385, id = 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 }) 2021-01-13T07:49:36.212-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:49:36.213-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0005_n1_thisbuild, network = { name = cbas-docker-test-0002-c5316380-20fe-4f92-b265-1d82ec106385, id = 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 }) 2021-01-13T07:49:37.158-08:00 INFO DockerTestBase [pool] Container information for 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c: host: n2.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55911->192.168.176.2:8091, 172.17.0.1:55903->192.168.176.2:8095 2021-01-13T07:49:37.236-08:00 INFO DockerTestBase [pool] Container information for 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53: host: n1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55915->192.168.176.3:8091, 172.17.0.1:55910->192.168.176.3:8095 2021-01-13T07:49:48.211-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.2) 2021-01-13T07:49:48.211-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:49:48.489-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.3) 2021-01-13T07:49:48.490-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:49:49.795-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:49:49.872-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:49:49.919-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.3) with services: [DATA, ANALYTICS] 2021-01-13T07:49:49.920-08:00 INFO DockerTestBase [main] Executing the command: docker exec 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:49:50.511-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:49:50.563-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.2) with services: [ANALYTICS] 2021-01-13T07:49:50.564-08:00 INFO DockerTestBase [main] Executing the command: docker exec 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:49:55.937-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:49:55.984-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T07:49:55.984-08:00 INFO DockerTestBase [main] Executing the command: docker exec 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase 2021-01-13T07:50:11.666-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T07:50:11.667-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T07:50:11.709-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T07:50:11.716-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T07:50:11.716-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:50:11.860-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55915] 2021-01-13T07:50:11.860-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:55915 2021-01-13T07:50:12.928-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55911] 2021-01-13T07:50:17.939-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:50:19.206-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T07:50:19.206-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T07:50:20.207-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:50:20.774-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2624 } 2021-01-13T07:50:20.774-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2624 } 2021-01-13T07:50:21.775-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:50:22.274-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3633 } 2021-01-13T07:50:22.274-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3633 } 2021-01-13T07:50:23.275-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:50:23.485-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:50:23.485-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:50:23.485-08:00 INFO UpgradeTestBase [main] Recreating 'n2' node (image = null, forceNewIp = true)... 2021-01-13T07:50:23.485-08:00 INFO DockerTestBase [main] Copying files from docker container 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0004_n2_thisbuild 2021-01-13T07:50:23.803-08:00 INFO DockerTestBase [main] Stopping docker container: 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c 2021-01-13T07:50:24.323-08:00 INFO DockerTestBase [main] Stopped docker container: 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c 2021-01-13T07:50:24.323-08:00 INFO DockerTestBase [main] Removing docker container: 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c 2021-01-13T07:50:24.339-08:00 INFO DockerTestBase [main] Removed docker container: 74311b3bc15d45b1c38a0ec3a87759fa7e06d30376542aaeb0ecf24e132e628c 2021-01-13T07:50:24.340-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0006_n2_thisbuild, network = { name = cbas-docker-test-0002-c5316380-20fe-4f92-b265-1d82ec106385, id = 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 }) 2021-01-13T07:50:25.351-08:00 INFO DockerTestBase [main] Container information for 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c: host: n2.couchbase.host, ip: 192.168.178.1, 172.17.0.1:55930->192.168.178.1:8091, 172.17.0.1:55926->192.168.178.1:8095 2021-01-13T07:50:35.600-08:00 INFO IpAddressRefreshITD [main] waiting to 4 minutes for IPs to refresh in the CC container & cluster to be active 2021-01-13T07:50:35.600-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 240s... 2021-01-13T07:50:35.601-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 240s... 2021-01-13T07:51:37.218-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55915] 2021-01-13T07:51:37.218-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55930] 2021-01-13T07:51:37.218-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T07:51:37.219-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:51:37.219-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:51:38.418-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2949 } 2021-01-13T07:51:38.419-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 1. ResultSet found : { "$1": 2949 } 2021-01-13T07:51:38.582-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T07:51:38.582-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 2949 } 2021-01-13T07:51:39.420-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T07:51:39.583-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:51:40.130-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 3588 } 2021-01-13T07:51:40.130-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 2. ResultSet found : { "$1": 3588 } 2021-01-13T07:51:40.146-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3618 } 2021-01-13T07:51:40.147-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 3618 } 2021-01-13T07:51:41.148-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:51:41.381-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 4418 } 2021-01-13T07:51:41.381-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 3. ResultSet found : { "$1": 4418 } 2021-01-13T07:51:41.477-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4418 } 2021-01-13T07:51:41.477-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 4418 } 2021-01-13T07:51:42.382-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T07:51:42.478-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:51:42.747-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5009 } 2021-01-13T07:51:42.747-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 4. ResultSet found : { "$1": 5009 } 2021-01-13T07:51:42.799-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5151 } 2021-01-13T07:51:42.799-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 5151 } 2021-01-13T07:51:43.801-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:51:43.942-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T07:51:43.942-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T07:51:44.053-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:51:44.053-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:51:44.054-08:00 INFO DockerTestBase [main] Copying files from docker container 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0005_n1_thisbuild 2021-01-13T07:51:44.588-08:00 INFO DockerTestBase [main] Stopping docker container: 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 2021-01-13T07:51:45.098-08:00 INFO DockerTestBase [main] Stopped docker container: 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 2021-01-13T07:51:45.120-08:00 INFO DockerTestBase [main] found 2 occurrences of 'ip address updated on refresh' in analytics_info.log on n1 (192.168.176.3) 2021-01-13T07:51:45.121-08:00 INFO DockerTestBase [main] Copying files from docker container 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD/refreshNcIpAddress/0006_n2_thisbuild 2021-01-13T07:51:45.483-08:00 INFO DockerTestBase [main] Stopping docker container: 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c 2021-01-13T07:51:45.925-08:00 INFO DockerTestBase [main] Stopped docker container: 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c 2021-01-13T07:51:45.926-08:00 INFO DockerTestBase [main] Removing docker container: 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c 2021-01-13T07:51:45.926-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 2021-01-13T07:51:45.939-08:00 INFO DockerTestBase [main] Removed docker container: 325793737a3da7debbc219c63c062d03a722f7cb2c3ee4a347d392a3d2cde17c 2021-01-13T07:51:45.949-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 62214e5fcba508a82cd7bf77576acf98067aaf41e476daae4371911dd7799d53 2021-01-13T07:51:45.950-08:00 INFO DockerTestBase [main] Removing docker network: 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 2021-01-13T07:51:46.016-08:00 INFO DockerTestBase [main] Removed docker network: 38e15d543d028d0749afca16d083877f7780b78b1a6d276a018401c8127b9be4 2021-01-13T07:51:46.019-08:00 WARN TestMethodTracer [main] ### refreshNcIpAddress SUCCEEDED [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 520.998 s <<< FAILURE! - in com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD [ERROR] refreshCcIpAddress(com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD) Time elapsed: 389.288 s <<< FAILURE! java.lang.AssertionError: Expected result to be { "$1": 5891 } but last result acquired = { "$1": 3911 } at com.couchbase.analytics.test.docker.lifecycle.IpAddressRefreshITD.refreshCcIpAddress(IpAddressRefreshITD.java:37) [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD 2021-01-13 07:51:48,859 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:51:48.963-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:51:48.992-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:51:48.993-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:51:49.161-08:00 WARN TestMethodTracer [main] ### testExternal603Target START 2021-01-13T07:51:50.661-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-807c0b45-c796-4634-a1c1-f6e00a5bb9c5) 2021-01-13T07:51:50.760-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-807c0b45-c796-4634-a1c1-f6e00a5bb9c5, id = 3027dea3dcd818aedb2bfe4f22758495428478a789771341b7d2782ba803fe01 } 2021-01-13T07:51:50.767-08:00 INFO UpgradeTestBase [pool] Creating source node using 'this build' docker image... 2021-01-13T07:51:50.779-08:00 INFO UpgradeTestBase [pool] Creating target node ([couchbase:enterprise-6.0.3])... 2021-01-13T07:51:50.780-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002target to /opt/couchbase/var 2021-01-13T07:51:50.783-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001source to /opt/couchbase/var 2021-01-13T07:51:50.783-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.0.3 2021-01-13T07:51:50.787-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:51:50.902-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:51:50.907-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:51:50.908-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:51:50.911-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:51:50.915-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD/testExternal603Target/0002_source_thisbuild, network = { name = cbas-docker-test-0001-807c0b45-c796-4634-a1c1-f6e00a5bb9c5, id = 3027dea3dcd818aedb2bfe4f22758495428478a789771341b7d2782ba803fe01 }) 2021-01-13T07:51:52.181-08:00 INFO DockerTestBase [pool] Container information for aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9: host: source.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55941->192.168.176.2:8095, 172.17.0.1:55945->192.168.176.2:8091 2021-01-13T07:51:52.949-08:00 INFO DockerTestBase [pool+] >> enterprise-6.0.3: Pulling from library/couchbase 2021-01-13T07:51:53.298-08:00 INFO DockerTestBase [pool+] >> 0a01a72a686c: Pulling fs layer 2021-01-13T07:51:53.299-08:00 INFO DockerTestBase [pool+] >> cc899a5544da: Pulling fs layer 2021-01-13T07:51:53.299-08:00 INFO DockerTestBase [pool+] >> 19197c550755: Pulling fs layer 2021-01-13T07:51:53.299-08:00 INFO DockerTestBase [pool+] >> 716d454e56b6: Pulling fs layer 2021-01-13T07:51:53.299-08:00 INFO DockerTestBase [pool+] >> daeec66b303e: Pulling fs layer 2021-01-13T07:51:53.300-08:00 INFO DockerTestBase [pool+] >> fdef4dea7c07: Pulling fs layer 2021-01-13T07:51:53.300-08:00 INFO DockerTestBase [pool+] >> 1736c7202653: Pulling fs layer 2021-01-13T07:51:53.300-08:00 INFO DockerTestBase [pool+] >> a7e3c6b40104: Pulling fs layer 2021-01-13T07:51:53.301-08:00 INFO DockerTestBase [pool+] >> c240d6ace0e6: Pulling fs layer 2021-01-13T07:51:53.301-08:00 INFO DockerTestBase [pool+] >> 6b11af0ba1fd: Pulling fs layer 2021-01-13T07:51:53.301-08:00 INFO DockerTestBase [pool+] >> 4c83c24e35f2: Pulling fs layer 2021-01-13T07:51:53.301-08:00 INFO DockerTestBase [pool+] >> 9e766c5af12c: Pulling fs layer 2021-01-13T07:51:53.302-08:00 INFO DockerTestBase [pool+] >> 782017be5f83: Pulling fs layer 2021-01-13T07:51:53.302-08:00 INFO DockerTestBase [pool+] >> daeec66b303e: Waiting 2021-01-13T07:51:53.302-08:00 INFO DockerTestBase [pool+] >> fdef4dea7c07: Waiting 2021-01-13T07:51:53.302-08:00 INFO DockerTestBase [pool+] >> 1736c7202653: Waiting 2021-01-13T07:51:53.303-08:00 INFO DockerTestBase [pool+] >> a7e3c6b40104: Waiting 2021-01-13T07:51:53.303-08:00 INFO DockerTestBase [pool+] >> c240d6ace0e6: Waiting 2021-01-13T07:51:53.303-08:00 INFO DockerTestBase [pool+] >> 6b11af0ba1fd: Waiting 2021-01-13T07:51:53.303-08:00 INFO DockerTestBase [pool+] >> 4c83c24e35f2: Waiting 2021-01-13T07:51:53.304-08:00 INFO DockerTestBase [pool+] >> 9e766c5af12c: Waiting 2021-01-13T07:51:53.304-08:00 INFO DockerTestBase [pool+] >> 782017be5f83: Waiting 2021-01-13T07:51:53.304-08:00 INFO DockerTestBase [pool+] >> 716d454e56b6: Waiting 2021-01-13T07:51:53.651-08:00 INFO DockerTestBase [pool+] >> 19197c550755: Verifying Checksum 2021-01-13T07:51:53.652-08:00 INFO DockerTestBase [pool+] >> 19197c550755: Download complete 2021-01-13T07:51:53.656-08:00 INFO DockerTestBase [pool+] >> cc899a5544da: Download complete 2021-01-13T07:51:53.998-08:00 INFO DockerTestBase [pool+] >> 716d454e56b6: Verifying Checksum 2021-01-13T07:51:53.999-08:00 INFO DockerTestBase [pool+] >> 716d454e56b6: Download complete 2021-01-13T07:51:54.355-08:00 INFO DockerTestBase [pool+] >> fdef4dea7c07: Verifying Checksum 2021-01-13T07:51:54.355-08:00 INFO DockerTestBase [pool+] >> fdef4dea7c07: Download complete 2021-01-13T07:51:54.777-08:00 INFO DockerTestBase [pool+] >> daeec66b303e: Verifying Checksum 2021-01-13T07:51:54.778-08:00 INFO DockerTestBase [pool+] >> daeec66b303e: Download complete 2021-01-13T07:51:55.035-08:00 INFO DockerTestBase [pool+] >> 0a01a72a686c: Verifying Checksum 2021-01-13T07:51:55.036-08:00 INFO DockerTestBase [pool+] >> 0a01a72a686c: Download complete 2021-01-13T07:51:55.228-08:00 INFO DockerTestBase [pool+] >> a7e3c6b40104: Verifying Checksum 2021-01-13T07:51:55.228-08:00 INFO DockerTestBase [pool+] >> a7e3c6b40104: Download complete 2021-01-13T07:51:55.400-08:00 INFO DockerTestBase [pool+] >> c240d6ace0e6: Download complete 2021-01-13T07:51:55.580-08:00 INFO DockerTestBase [pool+] >> 6b11af0ba1fd: Verifying Checksum 2021-01-13T07:51:55.581-08:00 INFO DockerTestBase [pool+] >> 6b11af0ba1fd: Download complete 2021-01-13T07:51:55.759-08:00 INFO DockerTestBase [pool+] >> 4c83c24e35f2: Verifying Checksum 2021-01-13T07:51:55.760-08:00 INFO DockerTestBase [pool+] >> 4c83c24e35f2: Download complete 2021-01-13T07:51:55.940-08:00 INFO DockerTestBase [pool+] >> 9e766c5af12c: Verifying Checksum 2021-01-13T07:51:55.941-08:00 INFO DockerTestBase [pool+] >> 9e766c5af12c: Download complete 2021-01-13T07:51:57.097-08:00 INFO DockerTestBase [pool+] >> 782017be5f83: Verifying Checksum 2021-01-13T07:51:57.098-08:00 INFO DockerTestBase [pool+] >> 782017be5f83: Download complete 2021-01-13T07:51:59.293-08:00 INFO DockerTestBase [pool+] >> 0a01a72a686c: Pull complete 2021-01-13T07:51:59.442-08:00 INFO DockerTestBase [pool+] >> cc899a5544da: Pull complete 2021-01-13T07:51:59.618-08:00 INFO DockerTestBase [pool+] >> 19197c550755: Pull complete 2021-01-13T07:51:59.833-08:00 INFO DockerTestBase [pool+] >> 716d454e56b6: Pull complete 2021-01-13T07:52:02.072-08:00 INFO DockerTestBase [pool+] >> daeec66b303e: Pull complete 2021-01-13T07:52:02.259-08:00 INFO DockerTestBase [pool+] >> fdef4dea7c07: Pull complete 2021-01-13T07:52:05.905-08:00 INFO DockerTestBase [pool+] >> 1736c7202653: Verifying Checksum 2021-01-13T07:52:05.906-08:00 INFO DockerTestBase [pool+] >> 1736c7202653: Download complete 2021-01-13T07:52:05.951-08:00 INFO DockerTestBase [pool] Running 'node-init' on node source (192.168.176.2) 2021-01-13T07:52:05.954-08:00 INFO DockerTestBase [pool] Executing the command: docker exec aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname source.couchbase.host 2021-01-13T07:52:07.176-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:52:07.247-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node source (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:52:07.248-08:00 INFO DockerTestBase [pool] Executing the command: docker exec aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:52:07.938-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:52:08.036-08:00 INFO DockerTestBase [pool] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:52:22.643-08:00 INFO DockerTestBase [pool+] >> 1736c7202653: Pull complete 2021-01-13T07:52:22.933-08:00 INFO DockerTestBase [pool+] >> a7e3c6b40104: Pull complete 2021-01-13T07:52:23.194-08:00 INFO DockerTestBase [pool+] >> c240d6ace0e6: Pull complete 2021-01-13T07:52:23.358-08:00 INFO DockerTestBase [pool+] >> 6b11af0ba1fd: Pull complete 2021-01-13T07:52:23.533-08:00 INFO DockerTestBase [pool+] >> 4c83c24e35f2: Pull complete 2021-01-13T07:52:23.705-08:00 INFO DockerTestBase [pool+] >> 9e766c5af12c: Pull complete 2021-01-13T07:52:23.845-08:00 INFO DockerTestBase [pool+] >> 782017be5f83: Pull complete 2021-01-13T07:52:23.855-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:9e28e17f28b2e115bdcb0cd145542f18db98c2885af990e043a888fca1d49892 2021-01-13T07:52:23.858-08:00 INFO DockerTestBase [pool+] >> Status: Downloaded newer image for couchbase:enterprise-6.0.3 2021-01-13T07:52:23.866-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.0.3 2021-01-13T07:52:23.868-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD/testExternal603Target/0001_target_couchbase_enterprise-6.0.3, network = { name = cbas-docker-test-0001-807c0b45-c796-4634-a1c1-f6e00a5bb9c5, id = 3027dea3dcd818aedb2bfe4f22758495428478a789771341b7d2782ba803fe01 }) 2021-01-13T07:52:24.926-08:00 INFO DockerTestBase [pool] Container information for daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109: host: target.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55956->192.168.176.3:8095, 172.17.0.1:55960->192.168.176.3:8091 2021-01-13T07:52:39.225-08:00 INFO DockerTestBase [pool] Running 'node-init' on node target (192.168.176.3) 2021-01-13T07:52:39.226-08:00 INFO DockerTestBase [pool] Executing the command: docker exec daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname target.couchbase.host 2021-01-13T07:52:40.092-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:52:40.104-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node target (192.168.176.3) with services: [DATA] 2021-01-13T07:52:40.104-08:00 INFO DockerTestBase [pool] Executing the command: docker exec daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:52:40.629-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:52:40.682-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55960] 2021-01-13T07:52:40.688-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:55960 2021-01-13T07:52:40.822-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55945] 2021-01-13T07:52:40.826-08:00 INFO DockerTestBase [main] Executing the command: docker exec aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 /opt/couchbase/bin/couchbase-cli analytics-link-setup -c 192.168.176.2 -u couchbase -p couchbase --create --dataverse Default --name externalcb --type couchbase --hostname target.couchbase.host --link-password couchbase --encryption half --link-username couchbase 2021-01-13T07:52:41.846-08:00 INFO DockerTestBase [main+] >> DEPRECATED: --dataverse is deprecated, please use --scope instead 2021-01-13T07:52:41.847-08:00 INFO DockerTestBase [main+] >> SUCCESS: Link created 2021-01-13T07:52:46.999-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:52:47.002-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:52:47.621-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T07:52:47.632-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T07:52:48.633-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:52:49.056-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2200 } 2021-01-13T07:52:49.056-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2200 } 2021-01-13T07:52:50.057-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:52:50.256-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:52:50.257-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:52:50.263-08:00 INFO DockerTestBase [main] Copying files from docker container daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD/testExternal603Target/0001_target_couchbase_enterprise-6.0.3 2021-01-13T07:52:50.264-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD/testExternal603Target/0002_source_thisbuild 2021-01-13T07:52:50.935-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 2021-01-13T07:52:50.947-08:00 INFO DockerTestBase [main] Stopping docker container: daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 2021-01-13T07:52:53.745-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 2021-01-13T07:52:53.891-08:00 INFO DockerTestBase [main] Stopped docker container: daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 2021-01-13T07:52:53.893-08:00 INFO DockerTestBase [main] Removing docker container: daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 2021-01-13T07:52:53.894-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 2021-01-13T07:52:53.984-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: aa6eab8878b043d6d712992ff27018f2ff0f57bc4fd212d7656889756159bfc9 2021-01-13T07:52:53.985-08:00 INFO DockerTestBase [main] Removed docker container: daae8fb0963f87623a2a2facb010fe43e6e243a489fd5093449530ae79856109 2021-01-13T07:52:53.987-08:00 INFO DockerTestBase [main] Removing docker network: 3027dea3dcd818aedb2bfe4f22758495428478a789771341b7d2782ba803fe01 2021-01-13T07:52:54.494-08:00 INFO DockerTestBase [main] Removed docker network: 3027dea3dcd818aedb2bfe4f22758495428478a789771341b7d2782ba803fe01 2021-01-13T07:52:54.504-08:00 WARN TestMethodTracer [main] ### testExternal603Target SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.361 s - in com.couchbase.analytics.test.docker.remote.CbRemoteLinks603ITD [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD 2021-01-13 07:52:57,193 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:52:57.352-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:52:57.383-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:52:57.383-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:52:57.534-08:00 WARN TestMethodTracer [main] ### testRemoteCluster START 2021-01-13T07:52:59.040-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-2941a74c-7ff4-43e6-91db-e1816d06f9f1) 2021-01-13T07:52:59.135-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-2941a74c-7ff4-43e6-91db-e1816d06f9f1, id = 899a07fd21970424649c8e5874a5af97aa3fbf772baad8d0d645e34fc5c2dad1 } 2021-01-13T07:52:59.142-08:00 INFO UpgradeTestBase [pool] Creating source node using 'this build' docker image... 2021-01-13T07:52:59.148-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001source to /opt/couchbase/var 2021-01-13T07:52:59.153-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:52:59.175-08:00 INFO UpgradeTestBase [pool] Creating target node ([couchbase:enterprise-6.5.1])... 2021-01-13T07:52:59.176-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002target to /opt/couchbase/var 2021-01-13T07:52:59.179-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.5.1 2021-01-13T07:52:59.259-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:52:59.264-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:52:59.264-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:52:59.267-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:52:59.271-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD/testRemoteCluster/0001_source_thisbuild, network = { name = cbas-docker-test-0001-2941a74c-7ff4-43e6-91db-e1816d06f9f1, id = 899a07fd21970424649c8e5874a5af97aa3fbf772baad8d0d645e34fc5c2dad1 }) 2021-01-13T07:53:00.595-08:00 INFO DockerTestBase [pool] Container information for abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d: host: source.couchbase.host, ip: 192.168.176.2, 172.17.0.1:55971->192.168.176.2:8095, 172.17.0.1:55975->192.168.176.2:8091 2021-01-13T07:53:01.639-08:00 INFO DockerTestBase [pool+] >> enterprise-6.5.1: Pulling from library/couchbase 2021-01-13T07:53:02.092-08:00 INFO DockerTestBase [pool+] >> 7b378fa0f908: Pulling fs layer 2021-01-13T07:53:02.092-08:00 INFO DockerTestBase [pool+] >> 4d77b1b29f2e: Pulling fs layer 2021-01-13T07:53:02.093-08:00 INFO DockerTestBase [pool+] >> 7c793be88bae: Pulling fs layer 2021-01-13T07:53:02.093-08:00 INFO DockerTestBase [pool+] >> ecc05c8a19c0: Pulling fs layer 2021-01-13T07:53:02.093-08:00 INFO DockerTestBase [pool+] >> b6c136657def: Pulling fs layer 2021-01-13T07:53:02.093-08:00 INFO DockerTestBase [pool+] >> aa1461bb5d2e: Pulling fs layer 2021-01-13T07:53:02.094-08:00 INFO DockerTestBase [pool+] >> 9b55a29a1243: Pulling fs layer 2021-01-13T07:53:02.094-08:00 INFO DockerTestBase [pool+] >> 83b73f9d6e17: Pulling fs layer 2021-01-13T07:53:02.094-08:00 INFO DockerTestBase [pool+] >> 0666e12c2dd1: Pulling fs layer 2021-01-13T07:53:02.094-08:00 INFO DockerTestBase [pool+] >> c25795a92553: Pulling fs layer 2021-01-13T07:53:02.095-08:00 INFO DockerTestBase [pool+] >> 98cdc6b09c86: Pulling fs layer 2021-01-13T07:53:02.095-08:00 INFO DockerTestBase [pool+] >> dcab35385e03: Pulling fs layer 2021-01-13T07:53:02.095-08:00 INFO DockerTestBase [pool+] >> a98f753b4c73: Pulling fs layer 2021-01-13T07:53:02.095-08:00 INFO DockerTestBase [pool+] >> 83b73f9d6e17: Waiting 2021-01-13T07:53:02.096-08:00 INFO DockerTestBase [pool+] >> 0666e12c2dd1: Waiting 2021-01-13T07:53:02.096-08:00 INFO DockerTestBase [pool+] >> c25795a92553: Waiting 2021-01-13T07:53:02.096-08:00 INFO DockerTestBase [pool+] >> 98cdc6b09c86: Waiting 2021-01-13T07:53:02.097-08:00 INFO DockerTestBase [pool+] >> dcab35385e03: Waiting 2021-01-13T07:53:02.097-08:00 INFO DockerTestBase [pool+] >> ecc05c8a19c0: Waiting 2021-01-13T07:53:02.097-08:00 INFO DockerTestBase [pool+] >> a98f753b4c73: Waiting 2021-01-13T07:53:02.097-08:00 INFO DockerTestBase [pool+] >> b6c136657def: Waiting 2021-01-13T07:53:02.098-08:00 INFO DockerTestBase [pool+] >> 9b55a29a1243: Waiting 2021-01-13T07:53:02.098-08:00 INFO DockerTestBase [pool+] >> aa1461bb5d2e: Waiting 2021-01-13T07:53:02.443-08:00 INFO DockerTestBase [pool+] >> 7c793be88bae: Verifying Checksum 2021-01-13T07:53:02.444-08:00 INFO DockerTestBase [pool+] >> 7c793be88bae: Download complete 2021-01-13T07:53:02.456-08:00 INFO DockerTestBase [pool+] >> 4d77b1b29f2e: Download complete 2021-01-13T07:53:02.823-08:00 INFO DockerTestBase [pool+] >> ecc05c8a19c0: Verifying Checksum 2021-01-13T07:53:02.823-08:00 INFO DockerTestBase [pool+] >> ecc05c8a19c0: Download complete 2021-01-13T07:53:03.054-08:00 INFO DockerTestBase [pool+] >> b6c136657def: Verifying Checksum 2021-01-13T07:53:03.056-08:00 INFO DockerTestBase [pool+] >> b6c136657def: Download complete 2021-01-13T07:53:03.172-08:00 INFO DockerTestBase [pool+] >> aa1461bb5d2e: Download complete 2021-01-13T07:53:03.757-08:00 INFO DockerTestBase [pool+] >> 83b73f9d6e17: Verifying Checksum 2021-01-13T07:53:03.758-08:00 INFO DockerTestBase [pool+] >> 83b73f9d6e17: Download complete 2021-01-13T07:53:03.858-08:00 INFO DockerTestBase [pool+] >> 7b378fa0f908: Verifying Checksum 2021-01-13T07:53:03.860-08:00 INFO DockerTestBase [pool+] >> 7b378fa0f908: Download complete 2021-01-13T07:53:04.113-08:00 INFO DockerTestBase [pool+] >> 0666e12c2dd1: Verifying Checksum 2021-01-13T07:53:04.117-08:00 INFO DockerTestBase [pool+] >> 0666e12c2dd1: Download complete 2021-01-13T07:53:04.214-08:00 INFO DockerTestBase [pool+] >> c25795a92553: Verifying Checksum 2021-01-13T07:53:04.214-08:00 INFO DockerTestBase [pool+] >> c25795a92553: Download complete 2021-01-13T07:53:04.459-08:00 INFO DockerTestBase [pool+] >> 98cdc6b09c86: Verifying Checksum 2021-01-13T07:53:04.460-08:00 INFO DockerTestBase [pool+] >> 98cdc6b09c86: Download complete 2021-01-13T07:53:04.587-08:00 INFO DockerTestBase [pool+] >> dcab35385e03: Verifying Checksum 2021-01-13T07:53:04.588-08:00 INFO DockerTestBase [pool+] >> dcab35385e03: Download complete 2021-01-13T07:53:04.810-08:00 INFO DockerTestBase [pool+] >> a98f753b4c73: Download complete 2021-01-13T07:53:07.879-08:00 INFO DockerTestBase [pool+] >> 7b378fa0f908: Pull complete 2021-01-13T07:53:08.100-08:00 INFO DockerTestBase [pool+] >> 4d77b1b29f2e: Pull complete 2021-01-13T07:53:08.275-08:00 INFO DockerTestBase [pool+] >> 7c793be88bae: Pull complete 2021-01-13T07:53:08.457-08:00 INFO DockerTestBase [pool+] >> ecc05c8a19c0: Pull complete 2021-01-13T07:53:09.690-08:00 INFO DockerTestBase [pool+] >> b6c136657def: Pull complete 2021-01-13T07:53:09.900-08:00 INFO DockerTestBase [pool+] >> aa1461bb5d2e: Pull complete 2021-01-13T07:53:12.743-08:00 INFO DockerTestBase [pool] Running 'node-init' on node source (192.168.176.2) 2021-01-13T07:53:12.746-08:00 INFO DockerTestBase [pool] Executing the command: docker exec abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname source.couchbase.host 2021-01-13T07:53:13.756-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:53:13.822-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node source (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:53:13.822-08:00 INFO DockerTestBase [pool] Executing the command: docker exec abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:53:14.426-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:53:14.509-08:00 INFO DockerTestBase [pool] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:53:16.185-08:00 INFO DockerTestBase [pool+] >> 9b55a29a1243: Verifying Checksum 2021-01-13T07:53:16.185-08:00 INFO DockerTestBase [pool+] >> 9b55a29a1243: Download complete 2021-01-13T07:53:36.576-08:00 INFO DockerTestBase [pool+] >> 9b55a29a1243: Pull complete 2021-01-13T07:53:36.710-08:00 INFO DockerTestBase [pool+] >> 83b73f9d6e17: Pull complete 2021-01-13T07:53:36.858-08:00 INFO DockerTestBase [pool+] >> 0666e12c2dd1: Pull complete 2021-01-13T07:53:37.020-08:00 INFO DockerTestBase [pool+] >> c25795a92553: Pull complete 2021-01-13T07:53:37.146-08:00 INFO DockerTestBase [pool+] >> 98cdc6b09c86: Pull complete 2021-01-13T07:53:37.273-08:00 INFO DockerTestBase [pool+] >> dcab35385e03: Pull complete 2021-01-13T07:53:37.409-08:00 INFO DockerTestBase [pool+] >> a98f753b4c73: Pull complete 2021-01-13T07:53:37.420-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:76c8f8324ea1f2eda9830eac2fff163648a07345aebf2574e778d74590a545e8 2021-01-13T07:53:37.425-08:00 INFO DockerTestBase [pool+] >> Status: Downloaded newer image for couchbase:enterprise-6.5.1 2021-01-13T07:53:37.426-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.5.1 2021-01-13T07:53:37.430-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD/testRemoteCluster/0002_target_couchbase_enterprise-6.5.1, network = { name = cbas-docker-test-0001-2941a74c-7ff4-43e6-91db-e1816d06f9f1, id = 899a07fd21970424649c8e5874a5af97aa3fbf772baad8d0d645e34fc5c2dad1 }) 2021-01-13T07:53:38.437-08:00 INFO DockerTestBase [pool] Container information for e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed: host: target.couchbase.host, ip: 192.168.176.3, 172.17.0.1:55986->192.168.176.3:8095, 172.17.0.1:55990->192.168.176.3:8091 2021-01-13T07:53:50.014-08:00 INFO DockerTestBase [pool] Running 'node-init' on node target (192.168.176.3) 2021-01-13T07:53:50.015-08:00 INFO DockerTestBase [pool] Executing the command: docker exec e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname target.couchbase.host 2021-01-13T07:53:54.642-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:53:54.691-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node target (192.168.176.3) with services: [DATA] 2021-01-13T07:53:54.691-08:00 INFO DockerTestBase [pool] Executing the command: docker exec e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:53:55.259-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:53:55.340-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55990] 2021-01-13T07:53:55.345-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:55990 2021-01-13T07:53:56.406-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:55975] 2021-01-13T07:53:56.409-08:00 INFO DockerTestBase [main] Executing the command: docker exec abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d /opt/couchbase/bin/couchbase-cli analytics-link-setup -c 192.168.176.2 -u couchbase -p couchbase --create --dataverse Default --name externalcb --type couchbase --hostname target.couchbase.host --link-password couchbase --encryption half --link-username couchbase 2021-01-13T07:53:57.399-08:00 INFO DockerTestBase [main+] >> DEPRECATED: --dataverse is deprecated, please use --scope instead 2021-01-13T07:53:57.400-08:00 INFO DockerTestBase [main+] >> SUCCESS: Link created 2021-01-13T07:54:01.504-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:54:01.507-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:54:02.062-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T07:54:02.071-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T07:54:03.073-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:54:03.373-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1740 } 2021-01-13T07:54:03.373-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 1740 } 2021-01-13T07:54:04.375-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:54:04.597-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5864 } 2021-01-13T07:54:04.598-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 5864 } 2021-01-13T07:54:05.800-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:54:05.800-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:54:05.805-08:00 INFO DockerTestBase [main] Copying files from docker container e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD/testRemoteCluster/0002_target_couchbase_enterprise-6.5.1 2021-01-13T07:54:05.805-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD/testRemoteCluster/0001_source_thisbuild 2021-01-13T07:54:06.245-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d 2021-01-13T07:54:06.429-08:00 INFO DockerTestBase [main] Stopping docker container: e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed 2021-01-13T07:54:07.416-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d 2021-01-13T07:54:07.461-08:00 INFO DockerTestBase [main] Stopped docker container: e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed 2021-01-13T07:54:07.463-08:00 INFO DockerTestBase [main] Removing docker container: e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed 2021-01-13T07:54:07.467-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d 2021-01-13T07:54:07.482-08:00 INFO DockerTestBase [main] Removed docker container: e6739ee25e7eebe3210df9ac58eca6dcc491a667f8ac9f7a3d1eb0d7617ddbed 2021-01-13T07:54:07.483-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: abf007b53d26548ea92c4add984183ed7a0227bb583041eccacea93b95b5298d 2021-01-13T07:54:07.485-08:00 INFO DockerTestBase [main] Removing docker network: 899a07fd21970424649c8e5874a5af97aa3fbf772baad8d0d645e34fc5c2dad1 2021-01-13T07:54:07.557-08:00 INFO DockerTestBase [main] Removed docker network: 899a07fd21970424649c8e5874a5af97aa3fbf772baad8d0d645e34fc5c2dad1 2021-01-13T07:54:07.567-08:00 WARN TestMethodTracer [main] ### testRemoteCluster SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.98 s - in com.couchbase.analytics.test.docker.remote.CbRemoteLinks651ITD [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD 2021-01-13 07:54:10,353 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:54:10.482-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:54:10.509-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:54:10.510-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:54:10.617-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:community-6.6.0.CE 2021-01-13T07:54:12.126-08:00 INFO DockerTestBase [main+] >> Error response from daemon: manifest for couchbase:community-6.6.0.CE not found: manifest unknown: manifest unknown 2021-01-13T07:54:12.141-08:00 WARN TestMethodTracer [main] ### testRemoteLink START 2021-01-13T07:54:13.615-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-dda96c17-c5c3-4bd7-84cc-67fba0a186fc) 2021-01-13T07:54:13.731-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-dda96c17-c5c3-4bd7-84cc-67fba0a186fc, id = a67dfe25c10a8feb807ddf85c51a1ff18f2174218049f7a6d636138d2e4dd42a } 2021-01-13T07:54:13.738-08:00 INFO UpgradeTestBase [pool] Creating source node using 'this build' docker image... 2021-01-13T07:54:13.745-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001source to /opt/couchbase/var 2021-01-13T07:54:13.746-08:00 INFO UpgradeTestBase [pool] Creating target node ([couchbase:community-6.6.0.CE])... 2021-01-13T07:54:13.748-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002target to /opt/couchbase/var 2021-01-13T07:54:13.756-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:54:13.758-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD/testRemoteLink/0001_target_couchbase_community-6.6.0.CE, network = { name = cbas-docker-test-0001-dda96c17-c5c3-4bd7-84cc-67fba0a186fc, id = a67dfe25c10a8feb807ddf85c51a1ff18f2174218049f7a6d636138d2e4dd42a }) 2021-01-13T07:54:13.870-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:54:13.873-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:54:13.874-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:54:13.877-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:54:13.880-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD/testRemoteLink/0002_source_thisbuild, network = { name = cbas-docker-test-0001-dda96c17-c5c3-4bd7-84cc-67fba0a186fc, id = a67dfe25c10a8feb807ddf85c51a1ff18f2174218049f7a6d636138d2e4dd42a }) 2021-01-13T07:54:13.978-08:00 ERRO DockerTestBase [pool] Error creating docker container com.github.dockerjava.api.exception.NotFoundException: No such image: couchbase:community-6.6.0.CE at com.github.dockerjava.jaxrs.filter.ResponseStatusExceptionFilter.filter(ResponseStatusExceptionFilter.java:53) ~[docker-java-3.1.5.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:133) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:121) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.process.internal.Stages.process(Stages.java:171) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:283) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$1(JerseyInvocation.java:767) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:316) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:298) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:229) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:765) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:456) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.post(JerseyInvocation.java:357) ~[jersey-client-2.27.jar:?] at com.github.dockerjava.jaxrs.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:33) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:14) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:23) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.CreateContainerCmdImpl.exec(CreateContainerCmdImpl.java:1139) ~[docker-java-3.1.5.jar:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:506) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:415) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:407) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:400) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:394) ~[test-classes/:?] at com.couchbase.analytics.test.docker.upgrade.UpgradeTestBase.createNode(UpgradeTestBase.java:152) ~[test-classes/:?] at com.couchbase.analytics.test.docker.remote.CbRemoteLinksDockerTestBase.lambda$runRemoteLinkTest$2(CbRemoteLinksDockerTestBase.java:91) ~[test-classes/:?] at com.couchbase.analytics.test.common.ClusterTestBase.lambda$invokeAll$32(ClusterTestBase.java:1130) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] at java.lang.Thread.run(Thread.java:834) [?:?] 2021-01-13T07:54:14.929-08:00 INFO DockerTestBase [pool] Container information for 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80: host: source.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56001->192.168.176.2:8095, 172.17.0.1:56005->192.168.176.2:8091 2021-01-13T07:54:25.361-08:00 INFO DockerTestBase [pool] Running 'node-init' on node source (192.168.176.2) 2021-01-13T07:54:25.363-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname source.couchbase.host 2021-01-13T07:54:26.697-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:54:26.750-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node source (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:54:26.752-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:54:27.324-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:54:27.386-08:00 INFO DockerTestBase [pool] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:54:42.077-08:00 INFO DockerTestBase [main] Taking cbcollect_info from source (192.168.176.2) 2021-01-13T07:54:42.078-08:00 INFO DockerTestBase [main] Executing the command: docker exec 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-13T07:54:42.243-08:00 INFO DockerTestBase [main+] >> 0 2021-01-13T07:54:42.257-08:00 INFO DockerTestBase [main] Executing the command: docker exec 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-13T07:56:36.682-08:00 INFO DockerTestBase [main] Finished taking cbcollect_info from source (192.168.176.2) 2021-01-13T07:56:36.682-08:00 INFO DockerTestBase [main] Copying files from docker container 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD/testRemoteLink/0002_source_thisbuild 2021-01-13T07:56:37.069-08:00 INFO DockerTestBase [main] Stopping docker container: 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 2021-01-13T07:56:37.574-08:00 INFO DockerTestBase [main] Stopped docker container: 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 2021-01-13T07:56:37.577-08:00 INFO DockerTestBase [main] Removing docker container: 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 2021-01-13T07:56:37.604-08:00 INFO DockerTestBase [main] Removed docker container: 42f7095713432d9f2ee99301b9364ab879132e0bb754959a53f48b1f1a75cf80 2021-01-13T07:56:37.606-08:00 INFO DockerTestBase [main] Removing docker network: a67dfe25c10a8feb807ddf85c51a1ff18f2174218049f7a6d636138d2e4dd42a 2021-01-13T07:56:37.690-08:00 INFO DockerTestBase [main] Removed docker network: a67dfe25c10a8feb807ddf85c51a1ff18f2174218049f7a6d636138d2e4dd42a 2021-01-13T07:56:37.701-08:00 WARN TestMethodTracer [main] ### testRemoteLink FAILED java.io.IOException: com.github.dockerjava.api.exception.NotFoundException: No such image: couchbase:community-6.6.0.CE at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:518) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:415) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:407) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:400) ~[test-classes/:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:394) ~[test-classes/:?] at com.couchbase.analytics.test.docker.upgrade.UpgradeTestBase.createNode(UpgradeTestBase.java:152) ~[test-classes/:?] at com.couchbase.analytics.test.docker.remote.CbRemoteLinksDockerTestBase.lambda$runRemoteLinkTest$2(CbRemoteLinksDockerTestBase.java:91) ~[test-classes/:?] at com.couchbase.analytics.test.common.ClusterTestBase.lambda$invokeAll$32(ClusterTestBase.java:1130) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?] at java.lang.Thread.run(Thread.java:834) ~[?:?] Caused by: com.github.dockerjava.api.exception.NotFoundException: No such image: couchbase:community-6.6.0.CE at com.github.dockerjava.jaxrs.filter.ResponseStatusExceptionFilter.filter(ResponseStatusExceptionFilter.java:53) ~[docker-java-3.1.5.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:133) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.ClientFilteringStages$ResponseFilterStage.apply(ClientFilteringStages.java:121) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.process.internal.Stages.process(Stages.java:171) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:283) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$1(JerseyInvocation.java:767) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:316) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:298) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.internal.Errors.process(Errors.java:229) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414) ~[jersey-common-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:765) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:456) ~[jersey-client-2.27.jar:?] at org.glassfish.jersey.client.JerseyInvocation$Builder.post(JerseyInvocation.java:357) ~[jersey-client-2.27.jar:?] at com.github.dockerjava.jaxrs.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:33) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:14) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.jaxrs.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:23) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35) ~[docker-java-3.1.5.jar:?] at com.github.dockerjava.core.command.CreateContainerCmdImpl.exec(CreateContainerCmdImpl.java:1139) ~[docker-java-3.1.5.jar:?] at com.couchbase.analytics.test.docker.DockerTestBase.createAndStartContainer(DockerTestBase.java:506) ~[test-classes/:?] ... 11 more [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 149.039 s <<< FAILURE! - in com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD [ERROR] testRemoteLink(com.couchbase.analytics.test.docker.remote.CbRemoteLinks660CEITD) Time elapsed: 145.577 s <<< ERROR! java.io.IOException: com.github.dockerjava.api.exception.NotFoundException: No such image: couchbase:community-6.6.0.CE Caused by: com.github.dockerjava.api.exception.NotFoundException: No such image: couchbase:community-6.6.0.CE [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD 2021-01-13 07:56:40,556 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:56:40.684-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:56:40.713-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:56:40.713-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:56:40.776-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.6.0 2021-01-13T07:56:43.115-08:00 INFO DockerTestBase [main+] >> enterprise-6.6.0: Pulling from library/couchbase 2021-01-13T07:56:43.130-08:00 INFO DockerTestBase [main+] >> Digest: sha256:7c2cb7b39d2b7e88d4885385bd996af5bbdf2cd39ee3d5725151aede8cc98f71 2021-01-13T07:56:43.131-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-6.6.0 2021-01-13T07:56:43.135-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.6.0 2021-01-13T07:56:43.149-08:00 WARN TestMethodTracer [main] ### testLoopbackCliTarget START 2021-01-13T07:56:44.929-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-93d58cda-4dc2-4132-b6ae-6da6d4116e91) 2021-01-13T07:56:45.120-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-93d58cda-4dc2-4132-b6ae-6da6d4116e91, id = f31e873a5b6f88f8a3133c3bd4d88c23b123554a01402c07c56c4119ac0c1414 } 2021-01-13T07:56:45.129-08:00 INFO UpgradeTestBase [pool] Creating target node ([couchbase:enterprise-6.6.0])... 2021-01-13T07:56:45.134-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001target to /opt/couchbase/var 2021-01-13T07:56:45.140-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD/testLoopbackCliTarget/0001_target_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-93d58cda-4dc2-4132-b6ae-6da6d4116e91, id = f31e873a5b6f88f8a3133c3bd4d88c23b123554a01402c07c56c4119ac0c1414 }) 2021-01-13T07:56:45.128-08:00 INFO UpgradeTestBase [pool] Creating source node using 'this build' docker image... 2021-01-13T07:56:45.143-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002source to /opt/couchbase/var 2021-01-13T07:56:45.146-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:56:45.361-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:56:45.404-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:56:45.405-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:56:45.443-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:56:45.455-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD/testLoopbackCliTarget/0002_source_thisbuild, network = { name = cbas-docker-test-0001-93d58cda-4dc2-4132-b6ae-6da6d4116e91, id = f31e873a5b6f88f8a3133c3bd4d88c23b123554a01402c07c56c4119ac0c1414 }) 2021-01-13T07:56:47.414-08:00 INFO DockerTestBase [pool] Container information for f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a: host: target.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56016->192.168.176.2:8095, 172.17.0.1:56024->192.168.176.2:8091 2021-01-13T07:56:47.414-08:00 INFO DockerTestBase [pool] Container information for 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a: host: source.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56031->192.168.176.3:8095, 172.17.0.1:56035->192.168.176.3:8091 2021-01-13T07:56:56.615-08:00 INFO DockerTestBase [pool] Running 'node-init' on node target (192.168.176.2) 2021-01-13T07:56:56.618-08:00 INFO DockerTestBase [pool] Executing the command: docker exec f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname target.couchbase.host 2021-01-13T07:56:58.086-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:56:58.130-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node target (192.168.176.2) with services: [DATA] 2021-01-13T07:56:58.130-08:00 INFO DockerTestBase [pool] Executing the command: docker exec f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:56:58.774-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:56:58.872-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56024] 2021-01-13T07:56:58.880-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:56024 2021-01-13T07:56:59.130-08:00 INFO DockerTestBase [pool] Running 'node-init' on node source (192.168.176.3) 2021-01-13T07:56:59.130-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname 127.0.0.1 2021-01-13T07:57:00.126-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:57:00.179-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node source (192.168.176.3) with services: [DATA, ANALYTICS] 2021-01-13T07:57:00.180-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:57:00.847-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:57:00.965-08:00 INFO DockerTestBase [pool] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:57:16.465-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56035] 2021-01-13T07:57:16.469-08:00 INFO DockerTestBase [main] Executing the command: docker exec 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a /opt/couchbase/bin/couchbase-cli analytics-link-setup -c 192.168.176.3 -u couchbase -p couchbase --create --dataverse Default --name externalcb --type couchbase --hostname target.couchbase.host --link-password couchbase --encryption none --link-username couchbase 2021-01-13T07:57:17.257-08:00 INFO DockerTestBase [main+] >> DEPRECATED: --dataverse is deprecated, please use --scope instead 2021-01-13T07:57:17.257-08:00 INFO DockerTestBase [main+] >> SUCCESS: Link created 2021-01-13T07:57:20.775-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:57:20.778-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:57:21.257-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T07:57:21.277-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T07:57:22.287-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:57:22.475-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 889 } 2021-01-13T07:57:22.475-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 889 } 2021-01-13T07:57:23.476-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:57:23.772-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5011 } 2021-01-13T07:57:23.773-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 5011 } 2021-01-13T07:57:24.904-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:57:24.905-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:57:24.910-08:00 INFO DockerTestBase [main] Copying files from docker container 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD/testLoopbackCliTarget/0002_source_thisbuild 2021-01-13T07:57:24.911-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD/testLoopbackCliTarget/0001_target_couchbase_enterprise-6.6.0 2021-01-13T07:57:25.364-08:00 INFO DockerTestBase [main] Stopping docker container: 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a 2021-01-13T07:57:25.400-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a 2021-01-13T07:57:26.057-08:00 INFO DockerTestBase [main] Stopped docker container: 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a 2021-01-13T07:57:26.123-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a 2021-01-13T07:57:26.124-08:00 INFO DockerTestBase [main] Removing docker container: 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a 2021-01-13T07:57:26.124-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a 2021-01-13T07:57:26.141-08:00 INFO DockerTestBase [main] Removed docker container: 474fe5933de9075eb6865c0e26448cc8eb473ebbd880e5c507c90b38e52d832a 2021-01-13T07:57:26.141-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: f159319ebcd1080a386d59b65be81e86a0522db5d5e5e0b8883d155835df852a 2021-01-13T07:57:26.143-08:00 INFO DockerTestBase [main] Removing docker network: f31e873a5b6f88f8a3133c3bd4d88c23b123554a01402c07c56c4119ac0c1414 2021-01-13T07:57:26.231-08:00 INFO DockerTestBase [main] Removed docker network: f31e873a5b6f88f8a3133c3bd4d88c23b123554a01402c07c56c4119ac0c1414 2021-01-13T07:57:26.240-08:00 WARN TestMethodTracer [main] ### testLoopbackCliTarget SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.395 s - in com.couchbase.analytics.test.docker.remote.CbRemoteLinks660ITD [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinks700ITD [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.023 s - in com.couchbase.analytics.test.docker.remote.CbRemoteLinks700ITD [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD 2021-01-13 07:57:30,330 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:57:30.461-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:57:30.490-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:57:30.491-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:57:30.646-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-5.5.2 2021-01-13T07:57:32.161-08:00 INFO DockerTestBase [main+] >> enterprise-5.5.2: Pulling from library/couchbase 2021-01-13T07:57:32.527-08:00 INFO DockerTestBase [main+] >> 18d680d61657: Pulling fs layer 2021-01-13T07:57:32.528-08:00 INFO DockerTestBase [main+] >> 0addb6fece63: Pulling fs layer 2021-01-13T07:57:32.528-08:00 INFO DockerTestBase [main+] >> 78e58219b215: Pulling fs layer 2021-01-13T07:57:32.528-08:00 INFO DockerTestBase [main+] >> eb6959a66df2: Pulling fs layer 2021-01-13T07:57:32.529-08:00 INFO DockerTestBase [main+] >> eb6959a66df2: Waiting 2021-01-13T07:57:32.529-08:00 INFO DockerTestBase [main+] >> 1b11929e4bba: Pulling fs layer 2021-01-13T07:57:32.529-08:00 INFO DockerTestBase [main+] >> a5c53dfb80d7: Pulling fs layer 2021-01-13T07:57:32.530-08:00 INFO DockerTestBase [main+] >> f8ba4b377591: Pulling fs layer 2021-01-13T07:57:32.530-08:00 INFO DockerTestBase [main+] >> 18924b37f297: Pulling fs layer 2021-01-13T07:57:32.530-08:00 INFO DockerTestBase [main+] >> 344e83dbe3d3: Pulling fs layer 2021-01-13T07:57:32.530-08:00 INFO DockerTestBase [main+] >> 1049a208a670: Pulling fs layer 2021-01-13T07:57:32.531-08:00 INFO DockerTestBase [main+] >> a5c53dfb80d7: Waiting 2021-01-13T07:57:32.531-08:00 INFO DockerTestBase [main+] >> f8ba4b377591: Waiting 2021-01-13T07:57:32.532-08:00 INFO DockerTestBase [main+] >> 18924b37f297: Waiting 2021-01-13T07:57:32.532-08:00 INFO DockerTestBase [main+] >> 344e83dbe3d3: Waiting 2021-01-13T07:57:32.533-08:00 INFO DockerTestBase [main+] >> 36612a3dd21b: Pulling fs layer 2021-01-13T07:57:32.533-08:00 INFO DockerTestBase [main+] >> 6fa79e1ff301: Pulling fs layer 2021-01-13T07:57:32.533-08:00 INFO DockerTestBase [main+] >> 1b11929e4bba: Waiting 2021-01-13T07:57:32.534-08:00 INFO DockerTestBase [main+] >> 1801915e2460: Pulling fs layer 2021-01-13T07:57:32.534-08:00 INFO DockerTestBase [main+] >> 1049a208a670: Waiting 2021-01-13T07:57:32.534-08:00 INFO DockerTestBase [main+] >> 1801915e2460: Waiting 2021-01-13T07:57:32.534-08:00 INFO DockerTestBase [main+] >> 36612a3dd21b: Waiting 2021-01-13T07:57:32.535-08:00 INFO DockerTestBase [main+] >> 6fa79e1ff301: Waiting 2021-01-13T07:57:32.932-08:00 INFO DockerTestBase [main+] >> 0addb6fece63: Verifying Checksum 2021-01-13T07:57:32.933-08:00 INFO DockerTestBase [main+] >> 0addb6fece63: Download complete 2021-01-13T07:57:32.954-08:00 INFO DockerTestBase [main+] >> 78e58219b215: Verifying Checksum 2021-01-13T07:57:32.955-08:00 INFO DockerTestBase [main+] >> 78e58219b215: Download complete 2021-01-13T07:57:33.279-08:00 INFO DockerTestBase [main+] >> eb6959a66df2: Verifying Checksum 2021-01-13T07:57:33.280-08:00 INFO DockerTestBase [main+] >> eb6959a66df2: Download complete 2021-01-13T07:57:33.644-08:00 INFO DockerTestBase [main+] >> a5c53dfb80d7: Verifying Checksum 2021-01-13T07:57:33.645-08:00 INFO DockerTestBase [main+] >> a5c53dfb80d7: Download complete 2021-01-13T07:57:33.937-08:00 INFO DockerTestBase [main+] >> 1b11929e4bba: Verifying Checksum 2021-01-13T07:57:33.938-08:00 INFO DockerTestBase [main+] >> 1b11929e4bba: Download complete 2021-01-13T07:57:34.310-08:00 INFO DockerTestBase [main+] >> 18924b37f297: Verifying Checksum 2021-01-13T07:57:34.311-08:00 INFO DockerTestBase [main+] >> 18924b37f297: Download complete 2021-01-13T07:57:34.402-08:00 INFO DockerTestBase [main+] >> 18d680d61657: Verifying Checksum 2021-01-13T07:57:34.403-08:00 INFO DockerTestBase [main+] >> 18d680d61657: Download complete 2021-01-13T07:57:34.668-08:00 INFO DockerTestBase [main+] >> 344e83dbe3d3: Verifying Checksum 2021-01-13T07:57:34.668-08:00 INFO DockerTestBase [main+] >> 344e83dbe3d3: Download complete 2021-01-13T07:57:34.778-08:00 INFO DockerTestBase [main+] >> 1049a208a670: Download complete 2021-01-13T07:57:35.223-08:00 INFO DockerTestBase [main+] >> 6fa79e1ff301: Verifying Checksum 2021-01-13T07:57:35.224-08:00 INFO DockerTestBase [main+] >> 6fa79e1ff301: Download complete 2021-01-13T07:57:36.014-08:00 INFO DockerTestBase [main+] >> 36612a3dd21b: Verifying Checksum 2021-01-13T07:57:36.014-08:00 INFO DockerTestBase [main+] >> 36612a3dd21b: Download complete 2021-01-13T07:57:36.044-08:00 INFO DockerTestBase [main+] >> 1801915e2460: Verifying Checksum 2021-01-13T07:57:36.045-08:00 INFO DockerTestBase [main+] >> 1801915e2460: Download complete 2021-01-13T07:57:37.548-08:00 INFO DockerTestBase [main+] >> 18d680d61657: Pull complete 2021-01-13T07:57:37.727-08:00 INFO DockerTestBase [main+] >> 0addb6fece63: Pull complete 2021-01-13T07:57:37.866-08:00 INFO DockerTestBase [main+] >> 78e58219b215: Pull complete 2021-01-13T07:57:37.997-08:00 INFO DockerTestBase [main+] >> eb6959a66df2: Pull complete 2021-01-13T07:57:39.717-08:00 INFO DockerTestBase [main+] >> 1b11929e4bba: Pull complete 2021-01-13T07:57:39.886-08:00 INFO DockerTestBase [main+] >> a5c53dfb80d7: Pull complete 2021-01-13T07:57:41.105-08:00 INFO DockerTestBase [main+] >> f8ba4b377591: Verifying Checksum 2021-01-13T07:57:41.105-08:00 INFO DockerTestBase [main+] >> f8ba4b377591: Download complete 2021-01-13T07:57:51.218-08:00 INFO DockerTestBase [main+] >> f8ba4b377591: Pull complete 2021-01-13T07:57:51.346-08:00 INFO DockerTestBase [main+] >> 18924b37f297: Pull complete 2021-01-13T07:57:51.486-08:00 INFO DockerTestBase [main+] >> 344e83dbe3d3: Pull complete 2021-01-13T07:57:51.618-08:00 INFO DockerTestBase [main+] >> 1049a208a670: Pull complete 2021-01-13T07:57:51.755-08:00 INFO DockerTestBase [main+] >> 36612a3dd21b: Pull complete 2021-01-13T07:57:51.886-08:00 INFO DockerTestBase [main+] >> 6fa79e1ff301: Pull complete 2021-01-13T07:57:52.013-08:00 INFO DockerTestBase [main+] >> 1801915e2460: Pull complete 2021-01-13T07:57:52.025-08:00 INFO DockerTestBase [main+] >> Digest: sha256:dcdf07a219ba5fe10bf6270082eb57b60320bb520a1f019b4793b9d0ec9fa2ba 2021-01-13T07:57:52.028-08:00 INFO DockerTestBase [main+] >> Status: Downloaded newer image for couchbase:enterprise-5.5.2 2021-01-13T07:57:52.031-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-5.5.2 2021-01-13T07:57:52.042-08:00 WARN TestMethodTracer [main] ### testPreAlice START 2021-01-13T07:57:53.822-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-35896734-e31c-40c9-8cf3-2424de2cf43e) 2021-01-13T07:57:53.948-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-35896734-e31c-40c9-8cf3-2424de2cf43e, id = 76bfd31e8823b26a2f3e44e129caa06fc11125ea996e8956e7f840c2f0f1b207 } 2021-01-13T07:57:53.957-08:00 INFO UpgradeTestBase [pool] Creating n1 node ([couchbase:enterprise-5.5.2])... 2021-01-13T07:57:53.964-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:57:53.966-08:00 INFO UpgradeTestBase [pool] Creating n2 node using 'this build' docker image... 2021-01-13T07:57:53.967-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:57:53.972-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:57:53.973-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD/testPreAlice/0001_n1_couchbase_enterprise-5.5.2, network = { name = cbas-docker-test-0001-35896734-e31c-40c9-8cf3-2424de2cf43e, id = 76bfd31e8823b26a2f3e44e129caa06fc11125ea996e8956e7f840c2f0f1b207 }) 2021-01-13T07:57:54.075-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:57:54.082-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:57:54.083-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:57:54.085-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:57:54.089-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD/testPreAlice/0002_n2_thisbuild, network = { name = cbas-docker-test-0001-35896734-e31c-40c9-8cf3-2424de2cf43e, id = 76bfd31e8823b26a2f3e44e129caa06fc11125ea996e8956e7f840c2f0f1b207 }) 2021-01-13T07:57:55.606-08:00 INFO DockerTestBase [pool] Container information for 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874: host: n2.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56049->192.168.176.2:8095, 172.17.0.1:56057->192.168.176.2:8091 2021-01-13T07:57:55.606-08:00 INFO DockerTestBase [pool] Container information for 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd: host: n1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56061->192.168.176.3:8095, 172.17.0.1:56065->192.168.176.3:8091 2021-01-13T07:58:06.935-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.2) 2021-01-13T07:58:06.938-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:58:09.113-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:58:09.173-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node n2 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T07:58:09.174-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:58:09.917-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:58:10.142-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.3) 2021-01-13T07:58:10.142-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:58:10.899-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:58:10.910-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node n1 (192.168.176.3) with services: [DATA] 2021-01-13T07:58:10.911-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:58:11.809-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:58:11.836-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:58:28.654-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56065] 2021-01-13T07:58:28.660-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56065 2021-01-13T07:58:28.739-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56057] 2021-01-13T07:58:29.163-08:00 INFO CbRemoteLinksIllegalVersionITD [main] create link threw exception java.lang.Exception: Invalid cluster compatibility version for external link, must be >= 6.0.x, <= 7.0.x but was 5.5.x (in line 1, at column 1) at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:295) ~[asterix-app-0.9.6-SNAPSHOT-tests.jar:0.9.6-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:210) ~[asterix-app-0.9.6-SNAPSHOT-tests.jar:0.9.6-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:153) ~[asterix-app-0.9.6-SNAPSHOT-tests.jar:0.9.6-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeUpdateOrDdl(TestExecutor.java:1622) ~[asterix-app-0.9.6-SNAPSHOT-tests.jar:0.9.6-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1611) ~[asterix-app-0.9.6-SNAPSHOT-tests.jar:0.9.6-SNAPSHOT] at com.couchbase.analytics.test.common.ClusterTestBase.executeSqlppUpdateOrDdl(ClusterTestBase.java:1213) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:] at com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD.testIllegalTargetVersion(CbRemoteLinksIllegalVersionITD.java:69) [test-classes/:?] at com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD.testPreAlice(CbRemoteLinksIllegalVersionITD.java:39) [test-classes/:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) [junit-4.13.jar:4.13] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.13.jar:4.13] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) [junit-4.13.jar:4.13] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.13.jar:4.13] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) [junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) [junit-4.13.jar:4.13] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) [junit-4.13.jar:4.13] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) [junit-4.13.jar:4.13] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) [junit-4.13.jar:4.13] at org.junit.runners.ParentRunner.run(ParentRunner.java:413) [junit-4.13.jar:4.13] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) [surefire-booter-2.21.0.jar:2.21.0] 2021-01-13T07:58:29.185-08:00 INFO DockerTestBase [main] Copying files from docker container 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD/testPreAlice/0001_n1_couchbase_enterprise-5.5.2 2021-01-13T07:58:29.186-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD/testPreAlice/0002_n2_thisbuild 2021-01-13T07:58:29.488-08:00 INFO DockerTestBase [main] Stopping docker container: 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd 2021-01-13T07:58:29.515-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 2021-01-13T07:58:30.130-08:00 INFO DockerTestBase [main] Stopped docker container: 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd 2021-01-13T07:58:30.172-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 2021-01-13T07:58:30.174-08:00 INFO DockerTestBase [main] Removing docker container: 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 2021-01-13T07:58:30.174-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd 2021-01-13T07:58:30.194-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 4c96e156ede1217626d36342cb0d53c25c16dedbfcdbdfc977950cf37757eecd 2021-01-13T07:58:30.201-08:00 INFO DockerTestBase [main] Removed docker container: 0b995ee949376d367b657426579659eeed3b66c3c9f428d7eef9244af38b7874 2021-01-13T07:58:30.203-08:00 INFO DockerTestBase [main] Removing docker network: 76bfd31e8823b26a2f3e44e129caa06fc11125ea996e8956e7f840c2f0f1b207 2021-01-13T07:58:30.297-08:00 INFO DockerTestBase [main] Removed docker network: 76bfd31e8823b26a2f3e44e129caa06fc11125ea996e8956e7f840c2f0f1b207 2021-01-13T07:58:30.307-08:00 WARN TestMethodTracer [main] ### testPreAlice SUCCEEDED [WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 61.828 s - in com.couchbase.analytics.test.docker.remote.CbRemoteLinksIllegalVersionITD [INFO] Running com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD 2021-01-13 07:58:32,985 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:58:33.108-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:58:33.135-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:58:33.136-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:58:33.196-08:00 WARN TestMethodTracer [main] ### testRemoteCluster START 2021-01-13T07:58:34.665-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-67f50f2c-5571-4451-8553-e524403c4239) 2021-01-13T07:58:34.767-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-67f50f2c-5571-4451-8553-e524403c4239, id = 40eb7a5e889e844fc2c9325554ee665adfa8c272d36d61245a0c7da56c397ba6 } 2021-01-13T07:58:34.775-08:00 INFO UpgradeTestBase [pool] Creating n2 node using 'this build' docker image... 2021-01-13T07:58:34.775-08:00 INFO UpgradeTestBase [pool] Creating n1 node using 'this build' docker image... 2021-01-13T07:58:34.780-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:58:34.780-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:58:34.787-08:00 INFO DockerTestBase [pool] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:58:34.880-08:00 INFO DockerTestBase [pool+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T07:58:34.887-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T07:58:34.887-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:58:34.888-08:00 INFO DockerTestBase [pool+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T07:58:34.895-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD/testRemoteCluster/0002_n2_thisbuild, network = { name = cbas-docker-test-0001-67f50f2c-5571-4451-8553-e524403c4239, id = 40eb7a5e889e844fc2c9325554ee665adfa8c272d36d61245a0c7da56c397ba6 }) 2021-01-13T07:58:34.895-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD/testRemoteCluster/0001_n1_thisbuild, network = { name = cbas-docker-test-0001-67f50f2c-5571-4451-8553-e524403c4239, id = 40eb7a5e889e844fc2c9325554ee665adfa8c272d36d61245a0c7da56c397ba6 }) 2021-01-13T07:58:36.506-08:00 INFO DockerTestBase [pool] Container information for 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56090->192.168.176.2:8091, 172.17.0.1:56082->192.168.176.2:8095 2021-01-13T07:58:36.520-08:00 INFO DockerTestBase [pool] Container information for d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56095->192.168.176.3:8091, 172.17.0.1:56091->192.168.176.3:8095 2021-01-13T07:58:46.884-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:58:46.887-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:58:47.704-08:00 INFO DockerTestBase [pool] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:58:47.705-08:00 INFO DockerTestBase [pool] Executing the command: docker exec d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:58:47.919-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:58:47.984-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T07:58:47.985-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:58:48.567-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:58:49.097-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T07:58:49.158-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node n2 (192.168.176.3) with services: [DATA, ANALYTICS] 2021-01-13T07:58:49.158-08:00 INFO DockerTestBase [pool] Executing the command: docker exec d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T07:58:49.738-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T07:58:49.811-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T07:59:03.374-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56090] 2021-01-13T07:59:03.377-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56090 2021-01-13T07:59:04.453-08:00 INFO DockerTestBase [main] Generating certificates for cluster 1 2021-01-13T07:59:04.458-08:00 INFO DockerTestBase [main] Executing the command: openssl genrsa -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/ca.key 2048 2021-01-13T07:59:04.478-08:00 INFO DockerTestBase [main+] >> Generating RSA private key, 2048 bit long modulus (2 primes) 2021-01-13T07:59:04.562-08:00 INFO DockerTestBase [main+] >> ....................................+++++ 2021-01-13T07:59:04.666-08:00 INFO DockerTestBase [main+] >> .............................................................+++++ 2021-01-13T07:59:04.667-08:00 INFO DockerTestBase [main+] >> e is 65537 (0x010001) 2021-01-13T07:59:04.669-08:00 INFO DockerTestBase [main] Executing the command: openssl req -config /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-server/target/test-classes/tls/rootConfig.conf -new -x509 -days 1 -sha256 -key /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/ca.key -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/ca.pem -subj /C=UA/O=MyCompany/CN=RootCA 2021-01-13T07:59:04.689-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -text -noout -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/ca.pem 2021-01-13T07:59:04.696-08:00 INFO DockerTestBase [main+] >> Certificate: 2021-01-13T07:59:04.697-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:04.699-08:00 INFO DockerTestBase [main+] >> Version: 3 (0x2) 2021-01-13T07:59:04.705-08:00 INFO DockerTestBase [main+] >> Serial Number: 2021-01-13T07:59:04.706-08:00 INFO DockerTestBase [main+] >> 12:70:a8:47:ba:af:b0:54:86:e8:29:6c:29:1a:d3:bd:20:86:be:c4 2021-01-13T07:59:04.707-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:04.711-08:00 INFO DockerTestBase [main+] >> Issuer: C = UA, O = MyCompany, CN = RootCA 2021-01-13T07:59:04.712-08:00 INFO DockerTestBase [main+] >> Validity 2021-01-13T07:59:04.714-08:00 INFO DockerTestBase [main+] >> Not Before: Jan 13 15:59:04 2021 GMT 2021-01-13T07:59:04.715-08:00 INFO DockerTestBase [main+] >> Not After : Jan 14 15:59:04 2021 GMT 2021-01-13T07:59:04.720-08:00 INFO DockerTestBase [main+] >> Subject: C = UA, O = MyCompany, CN = RootCA 2021-01-13T07:59:04.721-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:04.721-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:04.722-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (2048 bit) 2021-01-13T07:59:04.722-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:04.723-08:00 INFO DockerTestBase [main+] >> 00:f5:d7:8f:d0:2c:a8:21:5d:33:d6:35:8b:de:9f: 2021-01-13T07:59:04.723-08:00 INFO DockerTestBase [main+] >> 30:2f:bd:d9:18:34:f5:3b:f0:80:11:49:b2:c6:37: 2021-01-13T07:59:04.724-08:00 INFO DockerTestBase [main+] >> 26:e0:65:21:c3:db:d4:fa:52:49:09:d5:ad:31:94: 2021-01-13T07:59:04.724-08:00 INFO DockerTestBase [main+] >> a2:a1:3c:4f:e0:a9:31:ab:9e:7b:4a:77:2e:d0:fa: 2021-01-13T07:59:04.725-08:00 INFO DockerTestBase [main+] >> 1a:8b:26:a3:33:d3:9e:f7:92:17:2d:41:65:8a:24: 2021-01-13T07:59:04.725-08:00 INFO DockerTestBase [main+] >> 82:d8:40:0a:a4:46:8a:b1:48:18:5f:90:fb:ee:62: 2021-01-13T07:59:04.726-08:00 INFO DockerTestBase [main+] >> 8c:a0:b0:d6:68:6a:b6:a7:fc:aa:b0:30:8f:4a:51: 2021-01-13T07:59:04.726-08:00 INFO DockerTestBase [main+] >> 2e:b1:61:b9:61:4e:3b:f7:53:bf:32:57:3b:ec:48: 2021-01-13T07:59:04.727-08:00 INFO DockerTestBase [main+] >> b2:d9:ce:78:6b:45:c0:6b:87:d9:2b:51:1d:a3:3f: 2021-01-13T07:59:04.727-08:00 INFO DockerTestBase [main+] >> e8:36:e1:d9:b5:54:3e:31:6a:b0:2f:77:e4:e6:d0: 2021-01-13T07:59:04.728-08:00 INFO DockerTestBase [main+] >> d7:a1:d2:a4:4b:9a:21:8e:de:9f:f0:f4:23:90:0e: 2021-01-13T07:59:04.728-08:00 INFO DockerTestBase [main+] >> ba:fd:cc:ca:83:a8:8d:7a:f0:74:30:6c:96:97:3d: 2021-01-13T07:59:04.729-08:00 INFO DockerTestBase [main+] >> 25:dd:db:e4:98:cb:f9:70:48:2b:c0:a9:e1:f1:1d: 2021-01-13T07:59:04.730-08:00 INFO DockerTestBase [main+] >> e7:b5:69:68:70:f2:ea:6e:6e:e5:f7:5f:ff:bc:ca: 2021-01-13T07:59:04.730-08:00 INFO DockerTestBase [main+] >> 48:9c:b6:e5:85:2f:fe:e1:73:02:e5:b4:43:d4:ab: 2021-01-13T07:59:04.731-08:00 INFO DockerTestBase [main+] >> f4:fd:18:95:79:e4:43:4d:6e:56:b8:06:6f:f5:13: 2021-01-13T07:59:04.731-08:00 INFO DockerTestBase [main+] >> a4:57:05:ad:fe:05:c9:15:8b:84:0b:85:8e:66:5d: 2021-01-13T07:59:04.732-08:00 INFO DockerTestBase [main+] >> ae:5f 2021-01-13T07:59:04.732-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:04.733-08:00 INFO DockerTestBase [main+] >> X509v3 extensions: 2021-01-13T07:59:04.733-08:00 INFO DockerTestBase [main+] >> X509v3 Basic Constraints: 2021-01-13T07:59:04.734-08:00 INFO DockerTestBase [main+] >> CA:TRUE 2021-01-13T07:59:04.734-08:00 INFO DockerTestBase [main+] >> X509v3 Subject Key Identifier: 2021-01-13T07:59:04.735-08:00 INFO DockerTestBase [main+] >> F1:9E:8A:8D:16:32:19:62:C3:B5:78:34:A7:DD:34:6D:21:DF:04:6F 2021-01-13T07:59:04.735-08:00 INFO DockerTestBase [main+] >> X509v3 Authority Key Identifier: 2021-01-13T07:59:04.735-08:00 INFO DockerTestBase [main+] >> keyid:F1:9E:8A:8D:16:32:19:62:C3:B5:78:34:A7:DD:34:6D:21:DF:04:6F 2021-01-13T07:59:04.736-08:00 INFO DockerTestBase [main+] >> DirName:/C=UA/O=MyCompany/CN=RootCA 2021-01-13T07:59:04.736-08:00 INFO DockerTestBase [main+] >> serial:12:70:A8:47:BA:AF:B0:54:86:E8:29:6C:29:1A:D3:BD:20:86:BE:C4 2021-01-13T07:59:04.737-08:00 INFO DockerTestBase [main+] >> 2021-01-13T07:59:04.737-08:00 INFO DockerTestBase [main+] >> X509v3 Key Usage: 2021-01-13T07:59:04.738-08:00 INFO DockerTestBase [main+] >> Certificate Sign, CRL Sign 2021-01-13T07:59:04.738-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:04.738-08:00 INFO DockerTestBase [main+] >> 79:68:d7:02:ad:02:62:9a:f9:14:aa:7c:78:63:63:7b:23:46: 2021-01-13T07:59:04.739-08:00 INFO DockerTestBase [main+] >> e4:7e:30:22:34:e4:07:b3:08:61:5b:e8:a7:c6:89:e8:07:aa: 2021-01-13T07:59:04.739-08:00 INFO DockerTestBase [main+] >> f3:e9:a7:5a:07:8f:71:8c:1f:24:cb:cf:40:7f:a1:41:7d:7d: 2021-01-13T07:59:04.739-08:00 INFO DockerTestBase [main+] >> 20:ca:61:50:88:53:c6:18:b0:b7:1b:4a:47:12:6a:76:a8:d4: 2021-01-13T07:59:04.740-08:00 INFO DockerTestBase [main+] >> c9:5d:72:2a:40:cc:97:f0:5f:b0:1b:db:ca:9c:98:f8:f3:18: 2021-01-13T07:59:04.740-08:00 INFO DockerTestBase [main+] >> a5:1d:b5:ab:4d:10:7b:21:64:47:2e:d6:f6:e2:fe:51:3b:4a: 2021-01-13T07:59:04.741-08:00 INFO DockerTestBase [main+] >> 2d:cf:14:6e:17:1f:74:3e:4d:e8:11:ce:73:98:d0:0f:03:25: 2021-01-13T07:59:04.741-08:00 INFO DockerTestBase [main+] >> da:9a:72:28:ea:32:0e:6b:c9:bb:29:29:df:3b:1d:46:67:2f: 2021-01-13T07:59:04.742-08:00 INFO DockerTestBase [main+] >> 21:1b:db:2b:37:5c:5e:10:7e:ec:b1:28:43:20:af:77:29:99: 2021-01-13T07:59:04.742-08:00 INFO DockerTestBase [main+] >> 04:e7:4a:45:df:14:fa:da:3e:02:2d:99:08:b2:83:c3:c2:e1: 2021-01-13T07:59:04.743-08:00 INFO DockerTestBase [main+] >> b9:51:96:c8:2d:0b:2e:b1:12:ab:ab:e1:92:ef:68:ce:c0:34: 2021-01-13T07:59:04.743-08:00 INFO DockerTestBase [main+] >> 31:c2:db:fa:57:32:00:11:50:a5:86:df:17:de:4b:0c:24:6f: 2021-01-13T07:59:04.744-08:00 INFO DockerTestBase [main+] >> fb:4a:37:70:92:e4:df:b1:e2:33:c2:4b:4a:76:66:2d:0c:1c: 2021-01-13T07:59:04.744-08:00 INFO DockerTestBase [main+] >> 31:96:f9:36:e8:b2:ea:29:a3:dc:89:42:99:50:87:ea:a6:ea: 2021-01-13T07:59:04.745-08:00 INFO DockerTestBase [main+] >> d6:cd:eb:a8 2021-01-13T07:59:04.746-08:00 INFO DockerTestBase [main] Executing the command: openssl genrsa -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/int.key 1024 2021-01-13T07:59:04.752-08:00 INFO DockerTestBase [main+] >> Generating RSA private key, 1024 bit long modulus (2 primes) 2021-01-13T07:59:04.770-08:00 INFO DockerTestBase [main+] >> ..............................+++++ 2021-01-13T07:59:04.778-08:00 INFO DockerTestBase [main+] >> ..........+++++ 2021-01-13T07:59:04.779-08:00 INFO DockerTestBase [main+] >> e is 65537 (0x010001) 2021-01-13T07:59:04.780-08:00 INFO DockerTestBase [main] Executing the command: openssl req -new -days 1 -sha256 -key /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/int.key -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/requests/server-signing.csr -subj /C=UA/O=MyCompany/OU=Servers/CN=ServerSigningCA 2021-01-13T07:59:04.786-08:00 INFO DockerTestBase [main+] >> Ignoring -days; not generating a certificate 2021-01-13T07:59:04.789-08:00 INFO DockerTestBase [main+] >> Can't load /home/couchbase/.rnd into RNG 2021-01-13T07:59:04.789-08:00 INFO DockerTestBase [main+] >> 139990566822336:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/couchbase/.rnd 2021-01-13T07:59:04.790-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -CA /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/ca.pem -CAkey /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/ca.key -CAcreateserial -CAserial /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/server-signing.srl -days 1 -req -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/requests/server-signing.csr -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/int.pem -extfile /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-server/target/test-classes/tls/int.ext 2021-01-13T07:59:04.797-08:00 INFO DockerTestBase [main+] >> Signature ok 2021-01-13T07:59:04.799-08:00 INFO DockerTestBase [main+] >> subject=C = UA, O = MyCompany, OU = Servers, CN = ServerSigningCA 2021-01-13T07:59:04.799-08:00 INFO DockerTestBase [main+] >> Getting CA Private Key 2021-01-13T07:59:04.802-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -text -noout -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/int.pem 2021-01-13T07:59:04.810-08:00 INFO DockerTestBase [main+] >> Certificate: 2021-01-13T07:59:04.810-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:04.810-08:00 INFO DockerTestBase [main+] >> Version: 3 (0x2) 2021-01-13T07:59:04.811-08:00 INFO DockerTestBase [main+] >> Serial Number: 2021-01-13T07:59:04.813-08:00 INFO DockerTestBase [main+] >> 52:5c:9e:9c:37:09:d0:e5:33:51:9f:e8:b4:57:41:8e:45:62:72:b3 2021-01-13T07:59:04.815-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:04.819-08:00 INFO DockerTestBase [main+] >> Issuer: C = UA, O = MyCompany, CN = RootCA 2021-01-13T07:59:04.820-08:00 INFO DockerTestBase [main+] >> Validity 2021-01-13T07:59:04.821-08:00 INFO DockerTestBase [main+] >> Not Before: Jan 13 15:59:04 2021 GMT 2021-01-13T07:59:04.822-08:00 INFO DockerTestBase [main+] >> Not After : Jan 14 15:59:04 2021 GMT 2021-01-13T07:59:04.822-08:00 INFO DockerTestBase [main+] >> Subject: C = UA, O = MyCompany, OU = Servers, CN = ServerSigningCA 2021-01-13T07:59:04.822-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:04.828-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:04.828-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (1024 bit) 2021-01-13T07:59:04.828-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:04.831-08:00 INFO DockerTestBase [main+] >> 00:ad:46:ce:1c:62:80:91:ff:b2:10:ea:22:17:26: 2021-01-13T07:59:04.831-08:00 INFO DockerTestBase [main+] >> 63:c9:b1:d9:f3:3c:dd:90:f9:48:27:0b:f3:51:5e: 2021-01-13T07:59:04.831-08:00 INFO DockerTestBase [main+] >> a3:53:a0:02:7f:23:f1:b4:9e:c8:b6:58:a1:65:f2: 2021-01-13T07:59:04.832-08:00 INFO DockerTestBase [main+] >> cc:14:ad:d6:03:74:e5:9e:6b:cf:e4:54:b5:dc:47: 2021-01-13T07:59:04.832-08:00 INFO DockerTestBase [main+] >> 8e:a0:4f:9f:9e:c4:a8:83:c5:a6:f1:ff:a0:39:90: 2021-01-13T07:59:04.833-08:00 INFO DockerTestBase [main+] >> c5:81:fd:a2:2b:d6:b7:f9:8f:75:6e:db:32:58:94: 2021-01-13T07:59:04.833-08:00 INFO DockerTestBase [main+] >> 7c:06:3f:d5:60:c0:d9:59:4c:92:10:3b:cc:f3:08: 2021-01-13T07:59:04.834-08:00 INFO DockerTestBase [main+] >> c2:ab:b7:b9:5b:3a:69:89:91:b5:8a:92:63:c4:51: 2021-01-13T07:59:04.835-08:00 INFO DockerTestBase [main+] >> 71:85:78:7e:f9:c6:ee:20:37 2021-01-13T07:59:04.836-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:04.837-08:00 INFO DockerTestBase [main+] >> X509v3 extensions: 2021-01-13T07:59:04.837-08:00 INFO DockerTestBase [main+] >> X509v3 Basic Constraints: 2021-01-13T07:59:04.837-08:00 INFO DockerTestBase [main+] >> CA:TRUE 2021-01-13T07:59:04.838-08:00 INFO DockerTestBase [main+] >> X509v3 Subject Key Identifier: 2021-01-13T07:59:04.839-08:00 INFO DockerTestBase [main+] >> A8:F6:8F:A9:32:A0:57:70:0C:D8:51:30:FD:FC:48:32:85:E4:AA:FC 2021-01-13T07:59:04.840-08:00 INFO DockerTestBase [main+] >> X509v3 Authority Key Identifier: 2021-01-13T07:59:04.840-08:00 INFO DockerTestBase [main+] >> keyid:F1:9E:8A:8D:16:32:19:62:C3:B5:78:34:A7:DD:34:6D:21:DF:04:6F 2021-01-13T07:59:04.841-08:00 INFO DockerTestBase [main+] >> DirName:/C=UA/O=MyCompany/CN=RootCA 2021-01-13T07:59:04.841-08:00 INFO DockerTestBase [main+] >> serial:12:70:A8:47:BA:AF:B0:54:86:E8:29:6C:29:1A:D3:BD:20:86:BE:C4 2021-01-13T07:59:04.841-08:00 INFO DockerTestBase [main+] >> 2021-01-13T07:59:04.842-08:00 INFO DockerTestBase [main+] >> X509v3 Key Usage: 2021-01-13T07:59:04.843-08:00 INFO DockerTestBase [main+] >> Certificate Sign, CRL Sign 2021-01-13T07:59:04.843-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:04.844-08:00 INFO DockerTestBase [main+] >> b0:13:27:13:b6:43:12:9b:a8:28:25:59:06:2b:ee:21:2d:2b: 2021-01-13T07:59:04.845-08:00 INFO DockerTestBase [main+] >> 20:a2:4f:36:67:9b:8f:26:20:67:6b:f5:76:31:0f:ba:23:d3: 2021-01-13T07:59:04.846-08:00 INFO DockerTestBase [main+] >> f5:ce:f7:02:33:ea:0e:bd:af:de:a9:f3:84:0b:82:b2:0f:43: 2021-01-13T07:59:04.847-08:00 INFO DockerTestBase [main+] >> fc:ec:89:4d:29:55:c9:bd:85:33:5b:16:af:4d:4b:4a:90:de: 2021-01-13T07:59:04.847-08:00 INFO DockerTestBase [main+] >> 41:46:be:1e:63:6f:8f:92:75:fc:9d:ce:82:94:07:41:f3:90: 2021-01-13T07:59:04.848-08:00 INFO DockerTestBase [main+] >> b1:92:f7:3f:48:ae:05:3b:5d:5a:6b:d1:a1:e0:17:df:03:90: 2021-01-13T07:59:04.848-08:00 INFO DockerTestBase [main+] >> c4:1b:dc:2c:ea:96:c9:20:f8:df:4b:1e:a6:b3:13:81:1d:5b: 2021-01-13T07:59:04.849-08:00 INFO DockerTestBase [main+] >> b1:f9:bd:7d:72:0d:8b:f1:5c:d8:91:1c:e9:08:59:40:4a:12: 2021-01-13T07:59:04.849-08:00 INFO DockerTestBase [main+] >> 78:fb:3f:e6:f1:22:a4:65:20:4b:7e:c3:59:95:3b:88:7a:2e: 2021-01-13T07:59:04.850-08:00 INFO DockerTestBase [main+] >> ac:9a:2c:a1:f1:c3:50:31:0d:53:8c:8d:8a:0a:a6:26:42:cf: 2021-01-13T07:59:04.851-08:00 INFO DockerTestBase [main+] >> f5:68:0a:ab:6a:c1:58:e5:d9:41:f0:fe:3f:12:1f:09:08:95: 2021-01-13T07:59:04.851-08:00 INFO DockerTestBase [main+] >> 93:b8:61:be:9f:11:89:89:96:15:86:71:9b:9d:d6:80:d0:f9: 2021-01-13T07:59:04.851-08:00 INFO DockerTestBase [main+] >> 06:84:4c:a0:00:ff:f2:a7:c6:e6:de:72:97:b2:31:56:9f:7a: 2021-01-13T07:59:04.851-08:00 INFO DockerTestBase [main+] >> f9:59:8b:62:03:46:a4:37:23:20:ec:cf:2c:2a:01:9b:de:d8: 2021-01-13T07:59:04.852-08:00 INFO DockerTestBase [main+] >> c0:7e:93:56 2021-01-13T07:59:04.856-08:00 INFO DockerTestBase [main] Executing the command: openssl genrsa -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/couchbase.default.svc.n_1.key 2048 2021-01-13T07:59:04.863-08:00 INFO DockerTestBase [main+] >> Generating RSA private key, 2048 bit long modulus (2 primes) 2021-01-13T07:59:04.916-08:00 INFO DockerTestBase [main+] >> ......................+++++ 2021-01-13T07:59:04.942-08:00 INFO DockerTestBase [main+] >> ........+++++ 2021-01-13T07:59:04.943-08:00 INFO DockerTestBase [main+] >> e is 65537 (0x010001) 2021-01-13T07:59:04.946-08:00 INFO DockerTestBase [main] Executing the command: openssl req -new -sha256 -key /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/couchbase.default.svc.n_1.key -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/requests/couchbase.default.svc.n_1.csr -subj /CN=Couchbase Server 2021-01-13T07:59:04.953-08:00 INFO DockerTestBase [main+] >> Can't load /home/couchbase/.rnd into RNG 2021-01-13T07:59:04.954-08:00 INFO DockerTestBase [main+] >> 140107535364544:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/couchbase/.rnd 2021-01-13T07:59:04.964-08:00 INFO DockerTestBase [main] Executing the command: openssl req -text -noout -verify -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/requests/couchbase.default.svc.n_1.csr 2021-01-13T07:59:04.975-08:00 INFO DockerTestBase [main+] >> verify OK 2021-01-13T07:59:04.976-08:00 INFO DockerTestBase [main+] >> Certificate Request: 2021-01-13T07:59:04.977-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:04.977-08:00 INFO DockerTestBase [main+] >> Version: 1 (0x0) 2021-01-13T07:59:04.977-08:00 INFO DockerTestBase [main+] >> Subject: CN = Couchbase Server 2021-01-13T07:59:04.977-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:04.978-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:04.978-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (2048 bit) 2021-01-13T07:59:04.978-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:04.978-08:00 INFO DockerTestBase [main+] >> 00:b3:d5:cf:3f:e7:08:e9:a8:0b:05:4f:2c:b2:a4: 2021-01-13T07:59:04.978-08:00 INFO DockerTestBase [main+] >> 60:c7:ca:f5:ba:17:d2:43:0c:3f:f4:82:53:96:a8: 2021-01-13T07:59:04.979-08:00 INFO DockerTestBase [main+] >> a0:7b:e8:13:6d:46:09:4b:25:10:ea:98:a7:88:64: 2021-01-13T07:59:04.979-08:00 INFO DockerTestBase [main+] >> 3a:fe:41:50:53:a2:72:6f:e0:a6:85:20:9c:70:98: 2021-01-13T07:59:04.979-08:00 INFO DockerTestBase [main+] >> cc:f5:a9:de:3b:18:cc:e0:f8:12:d8:87:61:e6:5b: 2021-01-13T07:59:04.979-08:00 INFO DockerTestBase [main+] >> 01:c5:40:b8:01:fc:5c:69:e9:a5:c0:8b:0b:f1:f6: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> 6c:69:da:18:26:a3:4a:8b:83:5f:bc:f7:89:40:23: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> fb:58:7f:23:3e:46:91:ef:74:9a:4b:37:b3:0c:47: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> 00:ae:5c:02:80:8f:7c:cf:0d:6f:d8:3c:74:0d:bb: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> ae:a2:ab:d6:0c:b0:89:df:e8:ba:0b:4c:f9:08:f6: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> 2d:f5:8e:a3:3a:34:59:a9:2e:8a:2b:5b:f2:c7:0e: 2021-01-13T07:59:04.980-08:00 INFO DockerTestBase [main+] >> 02:55:63:a8:c0:4e:4e:9e:02:4f:ac:04:46:b6:14: 2021-01-13T07:59:04.981-08:00 INFO DockerTestBase [main+] >> 5a:61:e5:0f:ad:03:a5:c0:85:f4:d7:5f:3d:b7:a0: 2021-01-13T07:59:04.981-08:00 INFO DockerTestBase [main+] >> 24:74:79:68:65:f3:11:c2:f9:8f:4c:a2:93:c5:64: 2021-01-13T07:59:04.981-08:00 INFO DockerTestBase [main+] >> b3:12:af:a7:77:c0:e2:80:0c:3f:da:6a:d8:37:d1: 2021-01-13T07:59:04.981-08:00 INFO DockerTestBase [main+] >> 88:49:99:de:0a:29:d8:77:80:14:a8:9f:98:db:00: 2021-01-13T07:59:04.981-08:00 INFO DockerTestBase [main+] >> ed:1b:e7:d9:96:c5:b1:28:1e:5c:b0:1f:c0:af:fe: 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> cc:4b 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> Attributes: 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> a0:00 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:04.982-08:00 INFO DockerTestBase [main+] >> 09:eb:98:d0:40:ef:ad:90:6e:41:ff:fc:7e:78:55:1e:bf:7b: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> e0:5a:b8:a0:5f:9c:82:8c:36:5b:99:97:1a:91:aa:00:a7:6e: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> 2a:d5:2c:17:f1:a6:bb:19:36:9b:62:57:de:40:bd:18:09:23: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> bd:79:02:83:2c:a9:86:49:9f:4a:a8:1d:a6:76:f0:37:9e:04: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> b9:81:ba:d1:ed:85:d6:d0:a2:6a:9a:01:bb:c4:25:2b:39:a1: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> 62:2c:86:bf:17:5b:49:d7:1a:9f:21:93:41:91:2b:dc:b3:bc: 2021-01-13T07:59:04.983-08:00 INFO DockerTestBase [main+] >> 49:1c:fc:f6:f8:fe:33:31:79:e9:b9:3e:36:4c:ca:8d:fd:73: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> 3d:36:bc:f5:31:80:4f:ea:c1:20:d4:6c:a9:f7:5c:2e:2f:a6: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> bd:4e:fb:05:a5:1d:72:f8:03:bf:dc:58:36:3d:46:da:7c:c3: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> be:6f:f2:c1:12:c9:31:12:a5:8c:ce:14:60:1d:58:26:0c:47: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> e7:c0:32:1d:dd:07:38:1f:ec:2c:17:cf:36:b6:66:68:d5:d7: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> 78:84:ce:87:0c:77:28:6b:60:6c:8f:a1:18:b3:cd:37:e0:00: 2021-01-13T07:59:04.984-08:00 INFO DockerTestBase [main+] >> 2f:e1:a8:b3:98:f8:55:86:97:74:4c:6c:b0:d9:b7:90:ac:7e: 2021-01-13T07:59:04.985-08:00 INFO DockerTestBase [main+] >> de:f5:6d:f5:ce:87:58:a0:83:69:ca:03:65:35:c0:53:e7:b7: 2021-01-13T07:59:04.985-08:00 INFO DockerTestBase [main+] >> 22:99:ad:d8 2021-01-13T07:59:04.987-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -CA /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/int.pem -CAkey /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/int.key -CAcreateserial -days 1 -req -sha256 -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/requests/couchbase.default.svc.n_1.csr -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/couchbase.default.svc.n_1.pem -extfile /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/server.ext 2021-01-13T07:59:04.995-08:00 INFO DockerTestBase [main+] >> Signature ok 2021-01-13T07:59:04.996-08:00 INFO DockerTestBase [main+] >> subject=CN = Couchbase Server 2021-01-13T07:59:04.996-08:00 INFO DockerTestBase [main+] >> Getting CA Private Key 2021-01-13T07:59:04.998-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -text -noout -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/couchbase.default.svc.n_1.pem 2021-01-13T07:59:05.005-08:00 INFO DockerTestBase [main+] >> Certificate: 2021-01-13T07:59:05.006-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:05.006-08:00 INFO DockerTestBase [main+] >> Version: 3 (0x2) 2021-01-13T07:59:05.006-08:00 INFO DockerTestBase [main+] >> Serial Number: 2021-01-13T07:59:05.006-08:00 INFO DockerTestBase [main+] >> 1b:36:61:21:df:7d:95:41:5d:64:2d:2d:b4:88:91:d4:ce:26:27:2b 2021-01-13T07:59:05.007-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:05.007-08:00 INFO DockerTestBase [main+] >> Issuer: C = UA, O = MyCompany, OU = Servers, CN = ServerSigningCA 2021-01-13T07:59:05.007-08:00 INFO DockerTestBase [main+] >> Validity 2021-01-13T07:59:05.007-08:00 INFO DockerTestBase [main+] >> Not Before: Jan 13 15:59:04 2021 GMT 2021-01-13T07:59:05.008-08:00 INFO DockerTestBase [main+] >> Not After : Jan 14 15:59:04 2021 GMT 2021-01-13T07:59:05.008-08:00 INFO DockerTestBase [main+] >> Subject: CN = Couchbase Server 2021-01-13T07:59:05.008-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:05.008-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:05.009-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (2048 bit) 2021-01-13T07:59:05.009-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:05.010-08:00 INFO DockerTestBase [main+] >> 00:b3:d5:cf:3f:e7:08:e9:a8:0b:05:4f:2c:b2:a4: 2021-01-13T07:59:05.010-08:00 INFO DockerTestBase [main+] >> 60:c7:ca:f5:ba:17:d2:43:0c:3f:f4:82:53:96:a8: 2021-01-13T07:59:05.010-08:00 INFO DockerTestBase [main+] >> a0:7b:e8:13:6d:46:09:4b:25:10:ea:98:a7:88:64: 2021-01-13T07:59:05.011-08:00 INFO DockerTestBase [main+] >> 3a:fe:41:50:53:a2:72:6f:e0:a6:85:20:9c:70:98: 2021-01-13T07:59:05.011-08:00 INFO DockerTestBase [main+] >> cc:f5:a9:de:3b:18:cc:e0:f8:12:d8:87:61:e6:5b: 2021-01-13T07:59:05.012-08:00 INFO DockerTestBase [main+] >> 01:c5:40:b8:01:fc:5c:69:e9:a5:c0:8b:0b:f1:f6: 2021-01-13T07:59:05.012-08:00 INFO DockerTestBase [main+] >> 6c:69:da:18:26:a3:4a:8b:83:5f:bc:f7:89:40:23: 2021-01-13T07:59:05.012-08:00 INFO DockerTestBase [main+] >> fb:58:7f:23:3e:46:91:ef:74:9a:4b:37:b3:0c:47: 2021-01-13T07:59:05.012-08:00 INFO DockerTestBase [main+] >> 00:ae:5c:02:80:8f:7c:cf:0d:6f:d8:3c:74:0d:bb: 2021-01-13T07:59:05.013-08:00 INFO DockerTestBase [main+] >> ae:a2:ab:d6:0c:b0:89:df:e8:ba:0b:4c:f9:08:f6: 2021-01-13T07:59:05.013-08:00 INFO DockerTestBase [main+] >> 2d:f5:8e:a3:3a:34:59:a9:2e:8a:2b:5b:f2:c7:0e: 2021-01-13T07:59:05.013-08:00 INFO DockerTestBase [main+] >> 02:55:63:a8:c0:4e:4e:9e:02:4f:ac:04:46:b6:14: 2021-01-13T07:59:05.014-08:00 INFO DockerTestBase [main+] >> 5a:61:e5:0f:ad:03:a5:c0:85:f4:d7:5f:3d:b7:a0: 2021-01-13T07:59:05.014-08:00 INFO DockerTestBase [main+] >> 24:74:79:68:65:f3:11:c2:f9:8f:4c:a2:93:c5:64: 2021-01-13T07:59:05.014-08:00 INFO DockerTestBase [main+] >> b3:12:af:a7:77:c0:e2:80:0c:3f:da:6a:d8:37:d1: 2021-01-13T07:59:05.014-08:00 INFO DockerTestBase [main+] >> 88:49:99:de:0a:29:d8:77:80:14:a8:9f:98:db:00: 2021-01-13T07:59:05.014-08:00 INFO DockerTestBase [main+] >> ed:1b:e7:d9:96:c5:b1:28:1e:5c:b0:1f:c0:af:fe: 2021-01-13T07:59:05.015-08:00 INFO DockerTestBase [main+] >> cc:4b 2021-01-13T07:59:05.015-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:05.015-08:00 INFO DockerTestBase [main+] >> X509v3 extensions: 2021-01-13T07:59:05.015-08:00 INFO DockerTestBase [main+] >> X509v3 Basic Constraints: 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> CA:FALSE 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> X509v3 Subject Key Identifier: 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> 91:6E:D7:F3:EA:79:3F:3B:3F:A0:24:98:3B:F5:E1:A0:48:10:A6:21 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> X509v3 Authority Key Identifier: 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> keyid:A8:F6:8F:A9:32:A0:57:70:0C:D8:51:30:FD:FC:48:32:85:E4:AA:FC 2021-01-13T07:59:05.016-08:00 INFO DockerTestBase [main+] >> DirName:/C=UA/O=MyCompany/CN=RootCA 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> serial:52:5C:9E:9C:37:09:D0:E5:33:51:9F:E8:B4:57:41:8E:45:62:72:B3 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> X509v3 Extended Key Usage: 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> TLS Web Server Authentication 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> X509v3 Key Usage: 2021-01-13T07:59:05.017-08:00 INFO DockerTestBase [main+] >> Digital Signature, Key Encipherment 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> X509v3 Subject Alternative Name: 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> DNS:n1.couchbase.host 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> a3:b8:a5:16:75:f1:db:b4:bd:83:c5:a7:20:01:40:79:fa:5c: 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> 07:08:50:e4:13:f8:b4:20:2e:a7:bf:d3:7f:6c:22:74:fa:85: 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> cd:09:0f:d8:2b:ed:d4:ce:ef:84:3c:8c:8b:d8:47:6c:57:70: 2021-01-13T07:59:05.018-08:00 INFO DockerTestBase [main+] >> 7b:44:47:7f:8e:6d:58:df:c5:45:be:47:90:93:a0:16:2f:c9: 2021-01-13T07:59:05.019-08:00 INFO DockerTestBase [main+] >> 0a:60:cf:5a:0d:f4:cc:55:6f:fd:59:3d:3a:af:12:21:97:58: 2021-01-13T07:59:05.019-08:00 INFO DockerTestBase [main+] >> 4a:0c:42:52:a4:23:cb:31:a6:b9:0a:38:ba:86:dd:e5:cb:8b: 2021-01-13T07:59:05.019-08:00 INFO DockerTestBase [main+] >> be:48:f0:40:57:be:c3:27:08:a7:48:d4:a6:33:69:82:4e:42: 2021-01-13T07:59:05.019-08:00 INFO DockerTestBase [main+] >> 9a:5a 2021-01-13T07:59:05.030-08:00 INFO DockerTestBase [main] +http://172.17.0.1:56090/controller/uploadClusterCA 2021-01-13T07:59:05.134-08:00 INFO DockerTestBase [main] Executing the command: bash -c chmod a+x /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1/lib/couchbase/inbox/chain.pem 2021-01-13T07:59:05.144-08:00 INFO DockerTestBase [main] Executing the command: bash -c chmod a+x /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1/lib/couchbase/inbox/pkey.key 2021-01-13T07:59:05.155-08:00 INFO DockerTestBase [main] +http://172.17.0.1:56090/node/controller/reloadCertificate 2021-01-13T07:59:05.240-08:00 INFO DockerTestBase [main] +http://172.17.0.1:56090/settings/clientCertAuth 2021-01-13T07:59:05.247-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56095] 2021-01-13T07:59:05.251-08:00 INFO DockerTestBase [main] Executing the command: openssl genrsa -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.key 2048 2021-01-13T07:59:05.262-08:00 INFO DockerTestBase [main+] >> Generating RSA private key, 2048 bit long modulus (2 primes) 2021-01-13T07:59:05.448-08:00 INFO DockerTestBase [main+] >> ...................................................................................................+++++ 2021-01-13T07:59:05.511-08:00 INFO DockerTestBase [main+] >> .......................+++++ 2021-01-13T07:59:05.512-08:00 INFO DockerTestBase [main+] >> e is 65537 (0x010001) 2021-01-13T07:59:05.514-08:00 INFO DockerTestBase [main] Executing the command: openssl req -new -key /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.key -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.csr -subj /CN=couchbase 2021-01-13T07:59:05.524-08:00 INFO DockerTestBase [main+] >> Can't load /home/couchbase/.rnd into RNG 2021-01-13T07:59:05.524-08:00 INFO DockerTestBase [main+] >> 140316524143040:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/couchbase/.rnd 2021-01-13T07:59:05.528-08:00 INFO DockerTestBase [main] Executing the command: openssl req -text -noout -verify -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.csr 2021-01-13T07:59:05.534-08:00 INFO DockerTestBase [main+] >> verify OK 2021-01-13T07:59:05.535-08:00 INFO DockerTestBase [main+] >> Certificate Request: 2021-01-13T07:59:05.535-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:05.536-08:00 INFO DockerTestBase [main+] >> Version: 1 (0x0) 2021-01-13T07:59:05.536-08:00 INFO DockerTestBase [main+] >> Subject: CN = couchbase 2021-01-13T07:59:05.537-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:05.537-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:05.537-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (2048 bit) 2021-01-13T07:59:05.538-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:05.538-08:00 INFO DockerTestBase [main+] >> 00:bd:65:f5:ad:44:66:73:70:78:fe:6d:79:9d:30: 2021-01-13T07:59:05.538-08:00 INFO DockerTestBase [main+] >> ee:5a:6e:8c:09:51:13:83:3c:31:0e:07:16:b5:8c: 2021-01-13T07:59:05.539-08:00 INFO DockerTestBase [main+] >> 48:0f:56:27:7e:9c:ec:4d:1b:5f:ff:b2:2a:49:5d: 2021-01-13T07:59:05.539-08:00 INFO DockerTestBase [main+] >> 6c:6a:5d:67:5a:fb:76:ee:dc:3e:3f:43:8f:e3:80: 2021-01-13T07:59:05.540-08:00 INFO DockerTestBase [main+] >> 69:f5:f6:15:d0:37:ed:b3:b6:64:31:a3:47:75:7a: 2021-01-13T07:59:05.540-08:00 INFO DockerTestBase [main+] >> 39:c0:8b:c5:e4:a4:b7:f1:60:21:5e:e0:b0:97:a4: 2021-01-13T07:59:05.540-08:00 INFO DockerTestBase [main+] >> e2:e7:39:8b:e5:31:d3:ae:6f:4c:07:7b:4c:c0:86: 2021-01-13T07:59:05.541-08:00 INFO DockerTestBase [main+] >> 20:60:03:1f:dc:70:72:97:92:b4:0e:b3:7f:48:0e: 2021-01-13T07:59:05.541-08:00 INFO DockerTestBase [main+] >> 1f:87:1d:b8:74:26:5e:26:6b:31:db:31:7d:2a:45: 2021-01-13T07:59:05.541-08:00 INFO DockerTestBase [main+] >> 5c:0a:10:09:86:92:24:25:32:d1:8c:67:7b:1e:66: 2021-01-13T07:59:05.542-08:00 INFO DockerTestBase [main+] >> 48:eb:72:69:a0:11:e4:8a:87:79:b5:0b:53:09:ab: 2021-01-13T07:59:05.542-08:00 INFO DockerTestBase [main+] >> ad:16:e9:7c:97:23:4e:67:83:57:02:1a:c5:cb:48: 2021-01-13T07:59:05.542-08:00 INFO DockerTestBase [main+] >> 26:9f:be:8b:45:bb:9b:32:ab:6e:7f:4e:02:b3:5d: 2021-01-13T07:59:05.543-08:00 INFO DockerTestBase [main+] >> 26:bd:29:86:53:1a:df:3a:ef:db:1f:95:e5:fb:7a: 2021-01-13T07:59:05.544-08:00 INFO DockerTestBase [main+] >> 18:36:fc:93:3d:e0:22:64:4a:70:0e:a1:63:70:5d: 2021-01-13T07:59:05.544-08:00 INFO DockerTestBase [main+] >> d3:c2:9d:34:17:97:fd:91:c1:82:0e:d1:6a:24:32: 2021-01-13T07:59:05.544-08:00 INFO DockerTestBase [main+] >> 8e:98:4c:4c:b0:23:05:c2:d5:67:81:dc:e9:7e:cb: 2021-01-13T07:59:05.545-08:00 INFO DockerTestBase [main+] >> 28:e5 2021-01-13T07:59:05.546-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:05.546-08:00 INFO DockerTestBase [main+] >> Attributes: 2021-01-13T07:59:05.546-08:00 INFO DockerTestBase [main+] >> a0:00 2021-01-13T07:59:05.547-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:05.547-08:00 INFO DockerTestBase [main+] >> 51:50:8f:f1:ef:73:76:d4:91:d8:19:54:8b:79:57:90:09:39: 2021-01-13T07:59:05.548-08:00 INFO DockerTestBase [main+] >> 53:e9:2d:0f:30:a3:65:60:9f:ae:cb:0d:c8:f1:93:4e:e3:03: 2021-01-13T07:59:05.548-08:00 INFO DockerTestBase [main+] >> 45:c0:53:b1:63:ba:fc:f9:7f:d8:b0:d6:c4:b6:91:d5:16:07: 2021-01-13T07:59:05.548-08:00 INFO DockerTestBase [main+] >> 79:7b:5f:9f:5f:7b:8d:13:7e:7a:f1:7a:8c:b1:d4:95:a5:1a: 2021-01-13T07:59:05.549-08:00 INFO DockerTestBase [main+] >> 9f:10:c0:f2:69:9a:bb:47:04:0b:3b:31:9a:de:35:36:5b:9c: 2021-01-13T07:59:05.549-08:00 INFO DockerTestBase [main+] >> 14:af:32:9d:d3:04:e8:3d:7f:f2:47:62:76:1f:1e:2f:07:2a: 2021-01-13T07:59:05.551-08:00 INFO DockerTestBase [main+] >> a9:5d:b8:e3:42:f4:e7:85:a6:d6:ec:c2:aa:9a:57:e2:4f:f3: 2021-01-13T07:59:05.552-08:00 INFO DockerTestBase [main+] >> bc:13:db:68:12:9a:7d:d6:da:a0:fd:11:bd:28:08:9c:84:fa: 2021-01-13T07:59:05.552-08:00 INFO DockerTestBase [main+] >> d9:03:66:62:48:fe:a2:cd:3e:16:b2:98:b5:19:12:05:e9:b9: 2021-01-13T07:59:05.553-08:00 INFO DockerTestBase [main+] >> d1:e5:4f:bd:2f:0c:71:e8:6f:02:53:53:80:7f:f5:7c:b3:65: 2021-01-13T07:59:05.554-08:00 INFO DockerTestBase [main+] >> ad:5e:82:c3:49:da:43:b5:5a:b0:22:4b:46:35:b6:9d:bd:35: 2021-01-13T07:59:05.554-08:00 INFO DockerTestBase [main+] >> d7:f6:c0:71:39:fd:0c:69:ec:90:99:37:5c:66:9a:9b:34:17: 2021-01-13T07:59:05.554-08:00 INFO DockerTestBase [main+] >> 27:72:01:d4:e9:1d:fb:82:3d:0c:9e:cd:11:09:b8:ea:ff:75: 2021-01-13T07:59:05.555-08:00 INFO DockerTestBase [main+] >> ba:8e:19:e3:2d:10:a9:f4:ef:5e:9b:8a:e5:c7:ad:c0:e8:66: 2021-01-13T07:59:05.555-08:00 INFO DockerTestBase [main+] >> 1e:a6:55:38 2021-01-13T07:59:05.556-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -CA /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/public/int.pem -CAkey /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/private/int.key -CAcreateserial -days 1 -req -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.csr -out /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbase.pem -extfile /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-server/target/test-classes/tls/client.ext 2021-01-13T07:59:05.567-08:00 INFO DockerTestBase [main+] >> Signature ok 2021-01-13T07:59:05.568-08:00 INFO DockerTestBase [main+] >> subject=CN = couchbase 2021-01-13T07:59:05.568-08:00 INFO DockerTestBase [main+] >> Getting CA Private Key 2021-01-13T07:59:05.571-08:00 INFO DockerTestBase [main] Executing the command: openssl x509 -text -noout -in /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork/cluster1/client/client_couchbasechain.pem 2021-01-13T07:59:05.582-08:00 INFO DockerTestBase [main+] >> Certificate: 2021-01-13T07:59:05.582-08:00 INFO DockerTestBase [main+] >> Data: 2021-01-13T07:59:05.582-08:00 INFO DockerTestBase [main+] >> Version: 3 (0x2) 2021-01-13T07:59:05.583-08:00 INFO DockerTestBase [main+] >> Serial Number: 2021-01-13T07:59:05.583-08:00 INFO DockerTestBase [main+] >> 1b:36:61:21:df:7d:95:41:5d:64:2d:2d:b4:88:91:d4:ce:26:27:2c 2021-01-13T07:59:05.583-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:05.583-08:00 INFO DockerTestBase [main+] >> Issuer: C = UA, O = MyCompany, OU = Servers, CN = ServerSigningCA 2021-01-13T07:59:05.583-08:00 INFO DockerTestBase [main+] >> Validity 2021-01-13T07:59:05.584-08:00 INFO DockerTestBase [main+] >> Not Before: Jan 13 15:59:05 2021 GMT 2021-01-13T07:59:05.584-08:00 INFO DockerTestBase [main+] >> Not After : Jan 14 15:59:05 2021 GMT 2021-01-13T07:59:05.584-08:00 INFO DockerTestBase [main+] >> Subject: CN = couchbase 2021-01-13T07:59:05.584-08:00 INFO DockerTestBase [main+] >> Subject Public Key Info: 2021-01-13T07:59:05.584-08:00 INFO DockerTestBase [main+] >> Public Key Algorithm: rsaEncryption 2021-01-13T07:59:05.585-08:00 INFO DockerTestBase [main+] >> RSA Public-Key: (2048 bit) 2021-01-13T07:59:05.585-08:00 INFO DockerTestBase [main+] >> Modulus: 2021-01-13T07:59:05.585-08:00 INFO DockerTestBase [main+] >> 00:bd:65:f5:ad:44:66:73:70:78:fe:6d:79:9d:30: 2021-01-13T07:59:05.585-08:00 INFO DockerTestBase [main+] >> ee:5a:6e:8c:09:51:13:83:3c:31:0e:07:16:b5:8c: 2021-01-13T07:59:05.585-08:00 INFO DockerTestBase [main+] >> 48:0f:56:27:7e:9c:ec:4d:1b:5f:ff:b2:2a:49:5d: 2021-01-13T07:59:05.586-08:00 INFO DockerTestBase [main+] >> 6c:6a:5d:67:5a:fb:76:ee:dc:3e:3f:43:8f:e3:80: 2021-01-13T07:59:05.586-08:00 INFO DockerTestBase [main+] >> 69:f5:f6:15:d0:37:ed:b3:b6:64:31:a3:47:75:7a: 2021-01-13T07:59:05.586-08:00 INFO DockerTestBase [main+] >> 39:c0:8b:c5:e4:a4:b7:f1:60:21:5e:e0:b0:97:a4: 2021-01-13T07:59:05.586-08:00 INFO DockerTestBase [main+] >> e2:e7:39:8b:e5:31:d3:ae:6f:4c:07:7b:4c:c0:86: 2021-01-13T07:59:05.587-08:00 INFO DockerTestBase [main+] >> 20:60:03:1f:dc:70:72:97:92:b4:0e:b3:7f:48:0e: 2021-01-13T07:59:05.587-08:00 INFO DockerTestBase [main+] >> 1f:87:1d:b8:74:26:5e:26:6b:31:db:31:7d:2a:45: 2021-01-13T07:59:05.587-08:00 INFO DockerTestBase [main+] >> 5c:0a:10:09:86:92:24:25:32:d1:8c:67:7b:1e:66: 2021-01-13T07:59:05.587-08:00 INFO DockerTestBase [main+] >> 48:eb:72:69:a0:11:e4:8a:87:79:b5:0b:53:09:ab: 2021-01-13T07:59:05.589-08:00 INFO DockerTestBase [main+] >> ad:16:e9:7c:97:23:4e:67:83:57:02:1a:c5:cb:48: 2021-01-13T07:59:05.589-08:00 INFO DockerTestBase [main+] >> 26:9f:be:8b:45:bb:9b:32:ab:6e:7f:4e:02:b3:5d: 2021-01-13T07:59:05.590-08:00 INFO DockerTestBase [main+] >> 26:bd:29:86:53:1a:df:3a:ef:db:1f:95:e5:fb:7a: 2021-01-13T07:59:05.590-08:00 INFO DockerTestBase [main+] >> 18:36:fc:93:3d:e0:22:64:4a:70:0e:a1:63:70:5d: 2021-01-13T07:59:05.590-08:00 INFO DockerTestBase [main+] >> d3:c2:9d:34:17:97:fd:91:c1:82:0e:d1:6a:24:32: 2021-01-13T07:59:05.591-08:00 INFO DockerTestBase [main+] >> 8e:98:4c:4c:b0:23:05:c2:d5:67:81:dc:e9:7e:cb: 2021-01-13T07:59:05.591-08:00 INFO DockerTestBase [main+] >> 28:e5 2021-01-13T07:59:05.591-08:00 INFO DockerTestBase [main+] >> Exponent: 65537 (0x10001) 2021-01-13T07:59:05.591-08:00 INFO DockerTestBase [main+] >> X509v3 extensions: 2021-01-13T07:59:05.591-08:00 INFO DockerTestBase [main+] >> X509v3 Basic Constraints: 2021-01-13T07:59:05.592-08:00 INFO DockerTestBase [main+] >> CA:FALSE 2021-01-13T07:59:05.592-08:00 INFO DockerTestBase [main+] >> X509v3 Subject Key Identifier: 2021-01-13T07:59:05.592-08:00 INFO DockerTestBase [main+] >> 93:BB:10:FF:60:D6:57:A8:39:89:FB:54:55:C8:0C:8E:FB:C5:A1:88 2021-01-13T07:59:05.592-08:00 INFO DockerTestBase [main+] >> X509v3 Authority Key Identifier: 2021-01-13T07:59:05.593-08:00 INFO DockerTestBase [main+] >> keyid:A8:F6:8F:A9:32:A0:57:70:0C:D8:51:30:FD:FC:48:32:85:E4:AA:FC 2021-01-13T07:59:05.593-08:00 INFO DockerTestBase [main+] >> DirName:/C=UA/O=MyCompany/CN=RootCA 2021-01-13T07:59:05.593-08:00 INFO DockerTestBase [main+] >> serial:52:5C:9E:9C:37:09:D0:E5:33:51:9F:E8:B4:57:41:8E:45:62:72:B3 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> X509v3 Extended Key Usage: 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> TLS Web Client Authentication 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> X509v3 Key Usage: 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> Digital Signature 2021-01-13T07:59:05.594-08:00 INFO DockerTestBase [main+] >> Signature Algorithm: sha256WithRSAEncryption 2021-01-13T07:59:05.595-08:00 INFO DockerTestBase [main+] >> 55:42:59:e5:7c:a9:f8:66:70:9a:45:53:13:a5:99:cc:df:91: 2021-01-13T07:59:05.595-08:00 INFO DockerTestBase [main+] >> 13:eb:4b:96:4a:2c:0c:ce:ec:1d:ef:0a:67:29:0d:20:e1:f1: 2021-01-13T07:59:05.595-08:00 INFO DockerTestBase [main+] >> 13:9d:cf:8e:41:c2:4e:17:95:cc:fa:54:d0:65:93:19:bf:1a: 2021-01-13T07:59:05.596-08:00 INFO DockerTestBase [main+] >> f2:b5:d0:56:fe:af:71:20:23:31:46:cc:45:3b:e2:da:93:f9: 2021-01-13T07:59:05.596-08:00 INFO DockerTestBase [main+] >> 63:66:65:3e:bd:01:c9:44:a9:e4:ce:ce:ed:c4:05:78:0a:8b: 2021-01-13T07:59:05.596-08:00 INFO DockerTestBase [main+] >> 3a:21:10:eb:3f:89:d1:43:83:e3:ea:99:03:e3:c8:0f:f3:55: 2021-01-13T07:59:05.596-08:00 INFO DockerTestBase [main+] >> ba:95:4e:99:a9:d0:b3:8d:93:69:ab:aa:0a:73:7f:19:ef:94: 2021-01-13T07:59:05.597-08:00 INFO DockerTestBase [main+] >> 5f:ee 2021-01-13T07:59:15.421-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T07:59:15.424-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T07:59:15.824-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T07:59:15.834-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T07:59:16.835-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T07:59:17.023-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 163 } 2021-01-13T07:59:17.023-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 163 } 2021-01-13T07:59:18.024-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T07:59:18.210-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4256 } 2021-01-13T07:59:18.211-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 4256 } 2021-01-13T07:59:19.329-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T07:59:19.329-08:00 INFO DockerTestBase [main] Success 2021-01-13T07:59:19.335-08:00 INFO DockerTestBase [main] Copying files from docker container d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD/testRemoteCluster/0002_n2_thisbuild 2021-01-13T07:59:19.336-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD/testRemoteCluster/0001_n1_thisbuild 2021-01-13T07:59:19.738-08:00 INFO DockerTestBase [main] Stopping docker container: d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 2021-01-13T07:59:19.810-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef 2021-01-13T07:59:20.399-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef 2021-01-13T07:59:20.438-08:00 INFO DockerTestBase [main] Stopped docker container: d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 2021-01-13T07:59:20.440-08:00 INFO DockerTestBase [main] Removing docker container: 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef 2021-01-13T07:59:20.440-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 2021-01-13T07:59:20.456-08:00 INFO DockerTestBase [main] Removed docker container: 0a80ddac2cbfaaeadf5e7964a716d6a88f5b24ba52172f653df069bbfee2cfef 2021-01-13T07:59:20.456-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: d23072c77b0e19e82bbdb629586a504ef2f42c3b2fcdee2b80ea55cbda833741 2021-01-13T07:59:20.457-08:00 INFO DockerTestBase [main] Removing docker network: 40eb7a5e889e844fc2c9325554ee665adfa8c272d36d61245a0c7da56c397ba6 2021-01-13T07:59:20.584-08:00 INFO DockerTestBase [main] Removed docker network: 40eb7a5e889e844fc2c9325554ee665adfa8c272d36d61245a0c7da56c397ba6 2021-01-13T07:59:20.593-08:00 WARN TestMethodTracer [main] ### testRemoteCluster SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.259 s - in com.couchbase.analytics.test.docker.remote.CbRemoteTLSCertificatesITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD 2021-01-13 07:59:23,194 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T07:59:23.304-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T07:59:23.330-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T07:59:23.331-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T07:59:23.473-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.0.3 2021-01-13T07:59:24.626-08:00 INFO DockerTestBase [main+] >> enterprise-6.0.3: Pulling from library/couchbase 2021-01-13T07:59:24.637-08:00 INFO DockerTestBase [main+] >> Digest: sha256:9e28e17f28b2e115bdcb0cd145542f18db98c2885af990e043a888fca1d49892 2021-01-13T07:59:24.638-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-6.0.3 2021-01-13T07:59:24.641-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.0.3 2021-01-13T07:59:24.654-08:00 WARN TestMethodTracer [main] ### upgradeVerifyClusterCompat START 2021-01-13T07:59:26.206-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f) 2021-01-13T07:59:26.322-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f, id = 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 } 2021-01-13T07:59:26.325-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.3])... 2021-01-13T07:59:26.327-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T07:59:26.332-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0001_n1_couchbase_enterprise-6.0.3, network = { name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f, id = 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 }) 2021-01-13T07:59:27.582-08:00 INFO DockerTestBase [main] Container information for 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56110->192.168.176.2:8091, 172.17.0.1:56106->192.168.176.2:8095 2021-01-13T07:59:39.741-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T07:59:39.744-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T07:59:40.419-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:59:40.431-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.3])... 2021-01-13T07:59:40.432-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T07:59:40.433-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0002_n2_couchbase_enterprise-6.0.3, network = { name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f, id = 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 }) 2021-01-13T07:59:41.376-08:00 INFO DockerTestBase [main] Container information for e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56125->192.168.176.3:8091, 172.17.0.1:56121->192.168.176.3:8095 2021-01-13T07:59:53.451-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T07:59:53.452-08:00 INFO DockerTestBase [main] Executing the command: docker exec e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T07:59:54.190-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T07:59:54.206-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T07:59:54.207-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T07:59:54.754-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T07:59:54.765-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T07:59:54.767-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T07:59:59.345-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T07:59:59.357-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T07:59:59.359-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:00:03.868-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:00:03.868-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:00:03.897-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:00:03.920-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:00:03.939-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:00:12.790-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56110] 2021-01-13T08:00:12.796-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56110 2021-01-13T08:00:12.884-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56125] 2021-01-13T08:00:17.088-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:00:17.092-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:00:17.730-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:00:17.746-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:00:18.747-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:00:18.990-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 228 } 2021-01-13T08:00:18.991-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 228 } 2021-01-13T08:00:19.992-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:00:20.315-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2731 } 2021-01-13T08:00:20.316-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 2731 } 2021-01-13T08:00:21.518-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:00:21.519-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:00:21.519-08:00 INFO UpgradeTestBase [main] Upgrading n2.couchbase.host (online, rebalance) ... 2021-01-13T08:00:21.520-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T08:00:21.521-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n2new to /opt/couchbase/var 2021-01-13T08:00:21.522-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:00:21.645-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:00:21.649-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:00:21.650-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:00:21.653-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:00:21.658-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0003_n2new_thisbuild, network = { name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f, id = 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 }) 2021-01-13T08:00:22.883-08:00 INFO DockerTestBase [main] Container information for cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5: host: n2new.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56140->192.168.176.4:8091, 172.17.0.1:56136->192.168.176.4:8095 2021-01-13T08:00:34.949-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.4) 2021-01-13T08:00:34.949-08:00 INFO DockerTestBase [main] Executing the command: docker exec cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T08:00:37.117-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:00:37.160-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:00:37.161-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:00:44.604-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:00:44.616-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:00:44.617-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:00:44.618-08:00 INFO DockerTestBase [main] Executing the command: docker exec 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host 2021-01-13T08:01:08.880-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:01:08.881-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:01:08.897-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:01:08.926-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:01:08.926-08:00 INFO DockerTestBase [main] Copying files from docker container e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0002_n2_couchbase_enterprise-6.0.3 2021-01-13T08:01:09.265-08:00 INFO DockerTestBase [main] Stopping docker container: e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae 2021-01-13T08:01:09.748-08:00 INFO DockerTestBase [main] Stopped docker container: e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae 2021-01-13T08:01:09.749-08:00 INFO DockerTestBase [main] Removing docker container: e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae 2021-01-13T08:01:09.764-08:00 INFO DockerTestBase [main] Removed docker container: e1870ccd2508d027ff40de2e18f5f03308d72a5ea931b2ff6495568e97f411ae 2021-01-13T08:01:09.768-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:01:17.288-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56140] 2021-01-13T08:01:17.289-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:01:17.292-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:01:18.095-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:01:18.096-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:01:18.393-08:00 INFO DockerTestBase [main] assuming 6.0 compatibility on missing 'clusterCompatibility' field 2021-01-13T08:01:18.394-08:00 INFO UpgradeTestBase [main] Upgrading n1.couchbase.host (online, rebalance) ... 2021-01-13T08:01:18.394-08:00 INFO UpgradeTestBase [main] Creating n1-new node using 'this build' docker image... 2021-01-13T08:01:18.396-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n1new to /opt/couchbase/var 2021-01-13T08:01:18.397-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0004_n1new_thisbuild, network = { name = cbas-docker-test-0001-d555f626-41bb-4785-a47b-89e2bed9e77f, id = 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 }) 2021-01-13T08:01:19.439-08:00 INFO DockerTestBase [main] Container information for 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82: host: n1new.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56155->192.168.176.3:8091, 172.17.0.1:56151->192.168.176.3:8095 2021-01-13T08:01:30.976-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1new (192.168.176.3) 2021-01-13T08:01:30.976-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n1new.couchbase.host 2021-01-13T08:01:32.034-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:01:32.094-08:00 INFO DockerTestBase [main] Running 'server-add' for node n1new (192.168.176.3) with services: [DATA] 2021-01-13T08:01:32.095-08:00 INFO DockerTestBase [main] Executing the command: docker exec cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://n1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:01:36.812-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:01:36.861-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:01:36.862-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:01:36.862-08:00 INFO DockerTestBase [main] Executing the command: docker exec cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove n1.couchbase.host 2021-01-13T08:07:11.787-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:07:11.788-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:07:11.839-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:07:11.851-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:07:11.851-08:00 INFO DockerTestBase [main] Copying files from docker container 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0001_n1_couchbase_enterprise-6.0.3 2021-01-13T08:07:15.382-08:00 INFO DockerTestBase [main] Stopping docker container: 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb 2021-01-13T08:07:15.900-08:00 INFO DockerTestBase [main] Stopped docker container: 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb 2021-01-13T08:07:15.900-08:00 INFO DockerTestBase [main] Removing docker container: 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb 2021-01-13T08:07:15.922-08:00 INFO DockerTestBase [main] Removed docker container: 671cf49181559ea7677986260d571659d56d6be4f6b58bf74574f589b64a6feb 2021-01-13T08:07:15.938-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:07:15.943-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:07:16.948-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:17.953-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:18.958-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:19.963-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:20.968-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:21.973-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:22.979-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:23.984-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:24.989-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:07:26.427-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:07:27.895-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56140] 2021-01-13T08:07:27.896-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:07:27.896-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:07:28.704-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:07:28.705-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:07:28.706-08:00 INFO UpgradeTestBase [main] Verifying metadata 2021-01-13T08:07:28.706-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56140] 2021-01-13T08:07:28.707-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:07:29.239-08:00 INFO UpgradeFrom603ITD [main] topology nodes: [NodeInfo{nodeId='43b65cc40b1e98f7a14c85db32ec8a48', priority=0, opaque={cbas-version=7.0.0-1433530306, cc-http-port=9111, controller-id=1, host=n2new.couchbase.host, num-iodevices=1, starting-partition-id=1, svc-http-port=8095}}] 2021-01-13T08:07:29.261-08:00 INFO UpgradeFrom603ITD [main] 43b65cc40b1e98f7a14c85db32ec8a48 has cbas version ProductVersion 7.0.0 2021-01-13T08:07:29.281-08:00 INFO DockerTestBase [main] Copying files from docker container 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0004_n1new_thisbuild 2021-01-13T08:07:29.307-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD/upgradeVerifyClusterCompat/0003_n2new_thisbuild 2021-01-13T08:07:32.830-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 2021-01-13T08:07:34.298-08:00 INFO DockerTestBase [main] Stopping docker container: 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82 2021-01-13T08:07:34.551-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 2021-01-13T08:07:34.770-08:00 INFO DockerTestBase [main] Stopped docker container: 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82 2021-01-13T08:07:34.772-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 2021-01-13T08:07:34.772-08:00 INFO DockerTestBase [main] Removing docker container: 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82 2021-01-13T08:07:34.820-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: cb55606b87f330bad6554425714027f3d7afd6084e70a167c2a04bc61cabc0f5 2021-01-13T08:07:34.826-08:00 INFO DockerTestBase [main] Removed docker container: 5667d923aacdad055e83a19b9945ae180d15c469274eb9044b6fbd81d5ba3b82 2021-01-13T08:07:34.829-08:00 INFO DockerTestBase [main] Removing docker network: 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 2021-01-13T08:07:34.908-08:00 INFO DockerTestBase [main] Removed docker network: 3455298fcf1738aceeca8645f0c8573146e5fe4bcf10159d072692438d74ac12 2021-01-13T08:07:34.930-08:00 WARN TestMethodTracer [main] ### upgradeVerifyClusterCompat SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 493.322 s - in com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFrom603ITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD 2021-01-13 08:07:37,816 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:07:37.951-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:07:37.981-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:07:37.981-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:07:38.228-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics START 2021-01-13T08:07:39.989-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124) 2021-01-13T08:07:40.125-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e } 2021-01-13T08:07:40.150-08:00 INFO UpgradeTestBase [pool] Creating kv1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:07:40.152-08:00 INFO UpgradeTestBase [pool] Creating cbas1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:07:40.158-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001cbas1 to /opt/couchbase/var 2021-01-13T08:07:40.162-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.0.0 2021-01-13T08:07:40.152-08:00 INFO UpgradeTestBase [pool] Creating cbas2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:07:40.163-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas2 to /opt/couchbase/var 2021-01-13T08:07:40.163-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003kv1 to /opt/couchbase/var 2021-01-13T08:07:41.709-08:00 INFO DockerTestBase [pool+] >> enterprise-6.0.0: Pulling from library/couchbase 2021-01-13T08:07:42.957-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Pulling fs layer 2021-01-13T08:07:42.958-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Pulling fs layer 2021-01-13T08:07:42.958-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Pulling fs layer 2021-01-13T08:07:42.958-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Pulling fs layer 2021-01-13T08:07:42.959-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Pulling fs layer 2021-01-13T08:07:42.959-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Pulling fs layer 2021-01-13T08:07:42.959-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Pulling fs layer 2021-01-13T08:07:42.960-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Pulling fs layer 2021-01-13T08:07:42.960-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Pulling fs layer 2021-01-13T08:07:42.960-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Pulling fs layer 2021-01-13T08:07:42.960-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Waiting 2021-01-13T08:07:42.961-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Waiting 2021-01-13T08:07:42.961-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Pulling fs layer 2021-01-13T08:07:42.961-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Pulling fs layer 2021-01-13T08:07:42.962-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Pulling fs layer 2021-01-13T08:07:42.962-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Waiting 2021-01-13T08:07:42.962-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Waiting 2021-01-13T08:07:42.962-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Waiting 2021-01-13T08:07:42.963-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Waiting 2021-01-13T08:07:42.963-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Waiting 2021-01-13T08:07:42.963-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Waiting 2021-01-13T08:07:42.964-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Waiting 2021-01-13T08:07:42.964-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Waiting 2021-01-13T08:07:43.312-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Verifying Checksum 2021-01-13T08:07:43.313-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Download complete 2021-01-13T08:07:43.336-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Verifying Checksum 2021-01-13T08:07:43.336-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Download complete 2021-01-13T08:07:43.654-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Verifying Checksum 2021-01-13T08:07:43.654-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Download complete 2021-01-13T08:07:44.002-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Verifying Checksum 2021-01-13T08:07:44.002-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Download complete 2021-01-13T08:07:44.326-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Download complete 2021-01-13T08:07:44.941-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Download complete 2021-01-13T08:07:45.106-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Verifying Checksum 2021-01-13T08:07:45.107-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Download complete 2021-01-13T08:07:45.274-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Download complete 2021-01-13T08:07:45.433-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Verifying Checksum 2021-01-13T08:07:45.434-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Download complete 2021-01-13T08:07:45.628-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Verifying Checksum 2021-01-13T08:07:45.629-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Download complete 2021-01-13T08:07:45.769-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Verifying Checksum 2021-01-13T08:07:45.769-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Download complete 2021-01-13T08:07:48.019-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Pull complete 2021-01-13T08:07:48.194-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Pull complete 2021-01-13T08:07:48.362-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Pull complete 2021-01-13T08:07:48.521-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Pull complete 2021-01-13T08:07:50.305-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Pull complete 2021-01-13T08:07:50.491-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Pull complete 2021-01-13T08:07:52.050-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Verifying Checksum 2021-01-13T08:07:52.054-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Download complete 2021-01-13T08:08:02.178-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Pull complete 2021-01-13T08:08:02.302-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Pull complete 2021-01-13T08:08:02.425-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Pull complete 2021-01-13T08:08:02.553-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Pull complete 2021-01-13T08:08:02.681-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Pull complete 2021-01-13T08:08:02.813-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Pull complete 2021-01-13T08:08:03.254-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Pull complete 2021-01-13T08:08:03.269-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:342fb755176fb28c826b705721d69eb0fbba8631fd41f3a103806c235bbc6760 2021-01-13T08:08:03.281-08:00 INFO DockerTestBase [pool+] >> Status: Downloaded newer image for couchbase:enterprise-6.0.0 2021-01-13T08:08:03.284-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.0.0 2021-01-13T08:08:03.288-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0002_cbas2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:08:03.288-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0003_kv1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:08:03.289-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0001_cbas1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:08:04.990-08:00 INFO DockerTestBase [pool] Container information for bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922: host: kv1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56180->192.168.176.3:8095, 172.17.0.1:56185->192.168.176.3:8091 2021-01-13T08:08:05.028-08:00 INFO DockerTestBase [pool] Container information for 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b: host: cbas2.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56173->192.168.176.2:8095, 172.17.0.1:56181->192.168.176.2:8091 2021-01-13T08:08:05.772-08:00 INFO DockerTestBase [pool] Container information for 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b: host: cbas1.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56196->192.168.176.4:8095, 172.17.0.1:56200->192.168.176.4:8091 2021-01-13T08:08:20.879-08:00 INFO DockerTestBase [pool] Running 'node-init' on node kv1 (192.168.176.3) 2021-01-13T08:08:20.882-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname kv1.couchbase.host 2021-01-13T08:08:22.068-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas1 (192.168.176.4) 2021-01-13T08:08:22.069-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname cbas1.couchbase.host 2021-01-13T08:08:22.434-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas2 (192.168.176.2) 2021-01-13T08:08:22.434-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname cbas2.couchbase.host 2021-01-13T08:08:22.797-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:08:22.809-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node kv1 (192.168.176.3) with services: [DATA] 2021-01-13T08:08:22.809-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:08:23.143-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:08:23.511-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T08:08:23.626-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:08:23.649-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas1 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:08:23.650-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://cbas1.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:08:23.651-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas2 (192.168.176.2) with services: [ANALYTICS] 2021-01-13T08:08:23.651-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://cbas2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:08:28.628-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:08:39.090-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:08:39.104-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:08:39.105-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase 2021-01-13T08:08:40.610-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:08:40.611-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:08:40.662-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:08:40.680-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:08:40.715-08:00 INFO DockerTestBase [pool] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:08:40.852-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56200] 2021-01-13T08:08:40.867-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:56200 2021-01-13T08:08:53.330-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56200] 2021-01-13T08:08:57.954-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:08:58.589-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:08:58.594-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:09:00.122-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 888 } 2021-01-13T08:09:00.123-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 888 } 2021-01-13T08:09:01.544-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3537 } 2021-01-13T08:09:01.545-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3537 } 2021-01-13T08:09:02.726-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:09:02.727-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:09:02.728-08:00 INFO UpgradeFailoverTestBase [main] Failing over (hard) cbas nodes ... 2021-01-13T08:09:02.730-08:00 INFO DockerTestBase [main] Running 'failover --force' on [cbas1 (192.168.176.4), cbas2 (192.168.176.2)] nodes 2021-01-13T08:09:02.732-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli failover -c 192.168.176.3:8091 -u couchbase -p couchbase --server-failover cbas1.couchbase.host,cbas2.couchbase.host --force 2021-01-13T08:09:03.270-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server failed over 2021-01-13T08:09:08.294-08:00 INFO UpgradeTestBase [ForkJoinPool.commonPool-worker-3] Recreating 'cbas1' node (image = null, forceNewIp = false)... 2021-01-13T08:09:08.294-08:00 INFO UpgradeTestBase [main] Recreating 'cbas2' node (image = null, forceNewIp = false)... 2021-01-13T08:09:08.295-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0001_cbas1_couchbase_enterprise-6.0.0 2021-01-13T08:09:08.295-08:00 INFO DockerTestBase [main] Copying files from docker container 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0002_cbas2_couchbase_enterprise-6.0.0 2021-01-13T08:09:08.739-08:00 INFO DockerTestBase [main] Stopping docker container: 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b 2021-01-13T08:09:08.751-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b 2021-01-13T08:09:09.465-08:00 INFO DockerTestBase [main] Stopped docker container: 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b 2021-01-13T08:09:09.466-08:00 INFO DockerTestBase [main] Removing docker container: 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b 2021-01-13T08:09:09.487-08:00 INFO DockerTestBase [main] Removed docker container: 7794decb86481482230f4562f72e87cc1a4f7bfe031e67d99163111af284f85b 2021-01-13T08:09:09.491-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:09:09.517-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b 2021-01-13T08:09:09.517-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b 2021-01-13T08:09:09.532-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 43b86f6bd6fbcfee2fecf741ec07197537a5245b20ec751221b27691d1ef102b 2021-01-13T08:09:09.602-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:09:09.606-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:09:09.607-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:09:09.609-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:09:09.614-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:09:09.614-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:09:10.804-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Container information for 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c: host: cbas1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56220->192.168.176.2:8095, 172.17.0.1:56228->192.168.176.2:8091 2021-01-13T08:09:10.867-08:00 INFO DockerTestBase [main] Container information for e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092: host: cbas2.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56223->192.168.176.4:8095, 172.17.0.1:56230->192.168.176.4:8091 2021-01-13T08:09:22.040-08:00 INFO DockerTestBase [main] Running full 'recovery' on nodes [cbas1 (192.168.176.4), cbas2 (192.168.176.2)] 2021-01-13T08:09:22.042-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 /opt/couchbase/bin/couchbase-cli recovery -c 192.168.176.3:8091 -u couchbase -p couchbase --server-recovery cbas1.couchbase.host,cbas2.couchbase.host --recovery-type full 2021-01-13T08:09:22.491-08:00 INFO DockerTestBase [main+] >> SUCCESS: Servers recovered 2021-01-13T08:09:22.504-08:00 INFO UpgradeTestBase [main] Upgrading kv1.couchbase.host (online, rebalance) ... 2021-01-13T08:09:22.505-08:00 INFO UpgradeTestBase [main] Creating kv1-new node using 'this build' docker image... 2021-01-13T08:09:22.507-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004kv1new to /opt/couchbase/var 2021-01-13T08:09:22.508-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild, network = { name = cbas-docker-test-0001-84848d01-b7e7-4c88-8929-2b708f5d0124, id = 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e }) 2021-01-13T08:09:23.688-08:00 INFO DockerTestBase [main] Container information for e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203: host: kv1new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:56241->192.168.176.5:8095, 172.17.0.1:56245->192.168.176.5:8091 2021-01-13T08:09:34.742-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv1new (192.168.176.5) 2021-01-13T08:09:34.742-08:00 INFO DockerTestBase [main] Executing the command: docker exec e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname kv1new.couchbase.host 2021-01-13T08:09:35.928-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:09:35.966-08:00 INFO DockerTestBase [main] Running 'server-add' for node kv1new (192.168.176.5) with services: [DATA] 2021-01-13T08:09:35.966-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://kv1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:09:40.962-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:09:41.016-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:09:41.016-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:09:41.018-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove kv1.couchbase.host 2021-01-13T08:11:43.605-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:11:43.606-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:11:43.718-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:11:43.740-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:11:43.740-08:00 INFO DockerTestBase [main] Copying files from docker container bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0003_kv1_couchbase_enterprise-6.0.0 2021-01-13T08:11:44.481-08:00 INFO DockerTestBase [main] Stopping docker container: bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 2021-01-13T08:11:44.995-08:00 INFO DockerTestBase [main] Stopped docker container: bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 2021-01-13T08:11:45.003-08:00 INFO DockerTestBase [main] Removing docker container: bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 2021-01-13T08:11:45.022-08:00 INFO DockerTestBase [main] Removed docker container: bd239455f4edaa29133dd8ac22084dec07d39fc58a268a6cb394f3ea6a527922 2021-01-13T08:11:45.034-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:11:45.041-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:45.048-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:11:45.054-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:46.046-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:46.059-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:47.050-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:47.070-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:48.055-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:48.075-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:49.060-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:49.083-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:50.065-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:50.088-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:51.071-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:51.092-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:52.075-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:52.099-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:53.080-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:53.103-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:54.085-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:54.108-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:55.091-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:55.113-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:56.096-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:56.118-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:57.100-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:57.125-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:58.106-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:58.130-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:11:59.110-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:11:59.135-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:12:00.115-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:12:00.139-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:12:01.120-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:12:01.144-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:12:02.124-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:12:02.149-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:12:03.894-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:12:03.894-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:12:06.863-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56230] 2021-01-13T08:12:06.863-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56228] 2021-01-13T08:12:06.863-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:12:06.863-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:12:08.385-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:12:08.386-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:12:08.411-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:12:08.411-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:12:10.521-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:12:10.521-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:12:10.548-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:12:10.548-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:12:12.107-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 43 } 2021-01-13T08:12:12.108-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 43 } 2021-01-13T08:12:12.163-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 43 } 2021-01-13T08:12:12.163-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 3. ResultSet found : { "$1": 43 } 2021-01-13T08:12:13.705-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2104 } 2021-01-13T08:12:13.705-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 2104 } 2021-01-13T08:12:13.812-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2130 } 2021-01-13T08:12:13.813-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 4. ResultSet found : { "$1": 2130 } 2021-01-13T08:12:15.004-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2936 } 2021-01-13T08:12:15.004-08:00 INFO DockerTestBase [main] Failed attempt number: 5. ResultSet found : { "$1": 2936 } 2021-01-13T08:12:15.164-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2936 } 2021-01-13T08:12:15.165-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 5. ResultSet found : { "$1": 2936 } 2021-01-13T08:12:16.260-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5144 } 2021-01-13T08:12:16.260-08:00 INFO DockerTestBase [main] Failed attempt number: 6. ResultSet found : { "$1": 5144 } 2021-01-13T08:12:16.448-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5571 } 2021-01-13T08:12:16.448-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 6. ResultSet found : { "$1": 5571 } 2021-01-13T08:12:17.470-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:12:17.471-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:12:17.655-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:12:17.655-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:12:17.657-08:00 INFO DockerTestBase [main] Copying files from docker container e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild 2021-01-13T08:12:17.663-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild 2021-01-13T08:12:17.663-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild 2021-01-13T08:12:18.280-08:00 INFO DockerTestBase [main] Stopping docker container: e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092 2021-01-13T08:12:19.094-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203 2021-01-13T08:12:19.891-08:00 INFO DockerTestBase [main] Stopped docker container: e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092 2021-01-13T08:12:19.921-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c 2021-01-13T08:12:20.383-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203 2021-01-13T08:12:20.526-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c 2021-01-13T08:12:20.527-08:00 INFO DockerTestBase [main] Removing docker container: 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c 2021-01-13T08:12:20.527-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092 2021-01-13T08:12:20.528-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203 2021-01-13T08:12:20.539-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: e43337bfe27be237eb5848b1b64cedf40a606e71bddb4a531e50d04c48bbb092 2021-01-13T08:12:20.555-08:00 INFO DockerTestBase [main] Removed docker container: 5d0de616fad30d2c74c56bfeeeaf3ced5f33c59079bcd2849b13e1c06018d18c 2021-01-13T08:12:20.556-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: e825fd7672f085c2dfaf74ebe1ce0cf492175d390ce90223de16f879a3e9e203 2021-01-13T08:12:20.558-08:00 INFO DockerTestBase [main] Removing docker network: 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e 2021-01-13T08:12:20.646-08:00 INFO DockerTestBase [main] Removed docker network: 6eec02728174e9dcb7fa566a61ca54e06b171b17083c746a4d8a1b3c61293a1e 2021-01-13T08:12:20.655-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 284.649 s - in com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD 2021-01-13 08:12:23,630 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:12:23.765-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:12:23.791-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:12:23.792-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:12:23.984-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.0.0 2021-01-13T08:12:25.133-08:00 INFO DockerTestBase [main+] >> enterprise-6.0.0: Pulling from library/couchbase 2021-01-13T08:12:25.144-08:00 INFO DockerTestBase [main+] >> Digest: sha256:342fb755176fb28c826b705721d69eb0fbba8631fd41f3a103806c235bbc6760 2021-01-13T08:12:25.145-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-6.0.0 2021-01-13T08:12:25.146-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.0.0 2021-01-13T08:12:25.158-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutSingletonCBASOnlyOffline START 2021-01-13T08:12:26.600-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-05e4aa8b-6282-4c81-8842-463a808da729) 2021-01-13T08:12:26.719-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-05e4aa8b-6282-4c81-8842-463a808da729, id = 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b } 2021-01-13T08:12:26.720-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #1 ... 2021-01-13T08:12:26.721-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:12:26.724-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:12:26.728-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0001_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-05e4aa8b-6282-4c81-8842-463a808da729, id = 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b }) 2021-01-13T08:12:27.935-08:00 INFO DockerTestBase [main] Container information for 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56256->192.168.176.2:8095, 172.17.0.1:56260->192.168.176.2:8091 2021-01-13T08:12:40.340-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:12:40.343-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:12:41.213-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:12:41.224-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:12:41.225-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:12:41.710-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:12:41.721-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #2 ... 2021-01-13T08:12:41.723-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:12:41.728-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:12:41.730-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0002_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-05e4aa8b-6282-4c81-8842-463a808da729, id = 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b }) 2021-01-13T08:12:42.662-08:00 INFO DockerTestBase [main] Container information for 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56271->192.168.176.3:8095, 172.17.0.1:56275->192.168.176.3:8091 2021-01-13T08:12:56.153-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:12:56.153-08:00 INFO DockerTestBase [main] Executing the command: docker exec 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:12:56.982-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:12:56.994-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:12:56.995-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:13:01.310-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:13:01.323-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:13:01.324-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:13:01.326-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:13:05.761-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:13:05.761-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:13:05.791-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:13:05.804-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:13:05.822-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:13:14.248-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56260] 2021-01-13T08:13:14.254-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56260 2021-01-13T08:13:14.351-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56275] 2021-01-13T08:13:18.799-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:13:19.568-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:13:19.576-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:13:20.794-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 317 } 2021-01-13T08:13:20.794-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 317 } 2021-01-13T08:13:22.322-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3250 } 2021-01-13T08:13:22.323-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3250 } 2021-01-13T08:13:23.479-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:13:23.480-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:13:23.480-08:00 INFO UpgradeTestBase [main] Recreating 'n2' node (image = null, forceNewIp = false)... 2021-01-13T08:13:23.481-08:00 INFO DockerTestBase [main] Copying files from docker container 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0002_n2_couchbase_enterprise-6.0.0 2021-01-13T08:13:23.793-08:00 INFO DockerTestBase [main] Stopping docker container: 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4 2021-01-13T08:13:24.378-08:00 INFO DockerTestBase [main] Stopped docker container: 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4 2021-01-13T08:13:24.379-08:00 INFO DockerTestBase [main] Removing docker container: 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4 2021-01-13T08:13:24.407-08:00 INFO DockerTestBase [main] Removed docker container: 629cf9d3f98e82e4c2af1932b7b6a403cabd2f3070b2ede55dc929b20890fee4 2021-01-13T08:13:24.415-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:13:24.513-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:13:24.517-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:13:24.517-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:13:24.520-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:13:24.525-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0003_n2_thisbuild, network = { name = cbas-docker-test-0001-05e4aa8b-6282-4c81-8842-463a808da729, id = 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b }) 2021-01-13T08:13:25.431-08:00 INFO DockerTestBase [main] Container information for 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56286->192.168.176.3:8095, 172.17.0.1:56290->192.168.176.3:8091 2021-01-13T08:13:35.523-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:13:45.064-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56290] 2021-01-13T08:13:45.065-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:13:46.125-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:13:46.126-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:13:47.220-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:13:47.220-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:13:48.353-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:13:48.354-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 0 } 2021-01-13T08:13:49.556-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1614 } 2021-01-13T08:13:49.556-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 1614 } 2021-01-13T08:13:50.693-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:13:50.693-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:13:50.697-08:00 INFO DockerTestBase [main] Copying files from docker container 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0003_n2_thisbuild 2021-01-13T08:13:50.701-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutSingletonCBASOnlyOffline/0001_n1_couchbase_enterprise-6.0.0 2021-01-13T08:13:51.094-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 2021-01-13T08:13:51.129-08:00 INFO DockerTestBase [main] Stopping docker container: 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471 2021-01-13T08:13:51.759-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 2021-01-13T08:13:51.805-08:00 INFO DockerTestBase [main] Stopped docker container: 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471 2021-01-13T08:13:51.808-08:00 INFO DockerTestBase [main] Removing docker container: 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471 2021-01-13T08:13:51.808-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 2021-01-13T08:13:51.826-08:00 INFO DockerTestBase [main] Removed docker container: 9269f7a34fb9a73f7a795b5180687bf9ee76646589cf7c6dd8bc8f8ac58b2471 2021-01-13T08:13:51.834-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 5865edb418bb4e1a23310b24f28e3a997c2c975576548a73d16cedd6275b7da0 2021-01-13T08:13:51.836-08:00 INFO DockerTestBase [main] Removing docker network: 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b 2021-01-13T08:13:51.905-08:00 INFO DockerTestBase [main] Removed docker network: 0b9133274d1097046c432c791c9f455c56e1555615b7d35dd52880f17da2534b 2021-01-13T08:13:51.915-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutSingletonCBASOnlyOffline SUCCEEDED 2021-01-13T08:13:51.917-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyOffline START 2021-01-13T08:13:51.992-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386) 2021-01-13T08:13:52.054-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 } 2021-01-13T08:13:52.055-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #1 ... 2021-01-13T08:13:52.056-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:13:52.146-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:13:52.148-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0004_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 }) 2021-01-13T08:13:53.074-08:00 INFO DockerTestBase [main] Container information for 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56301->192.168.176.2:8095, 172.17.0.1:56305->192.168.176.2:8091 2021-01-13T08:14:06.131-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:14:06.132-08:00 INFO DockerTestBase [main] Executing the command: docker exec 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:14:06.949-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:14:06.960-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:14:06.960-08:00 INFO DockerTestBase [main] Executing the command: docker exec 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:14:07.472-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:14:07.484-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #2 ... 2021-01-13T08:14:07.485-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:14:07.510-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:14:07.512-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0005_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 }) 2021-01-13T08:14:08.520-08:00 INFO DockerTestBase [main] Container information for 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56316->192.168.176.3:8095, 172.17.0.1:56320->192.168.176.3:8091 2021-01-13T08:14:21.069-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:14:21.069-08:00 INFO DockerTestBase [main] Executing the command: docker exec 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:14:21.899-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:14:21.909-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #3 ... 2021-01-13T08:14:21.909-08:00 INFO UpgradeTestBase [main] Creating n3 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:14:21.910-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:14:21.910-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0006_n3_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 }) 2021-01-13T08:14:22.951-08:00 INFO DockerTestBase [main] Container information for 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56331->192.168.176.4:8095, 172.17.0.1:56335->192.168.176.4:8091 2021-01-13T08:14:36.027-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:14:36.027-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:14:36.790-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:14:36.799-08:00 INFO UpgradeFromAlice600ITD [main] Running server-add ... 2021-01-13T08:14:36.801-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:14:36.801-08:00 INFO DockerTestBase [main] Executing the command: docker exec 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:14:41.383-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:14:41.394-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:14:41.394-08:00 INFO DockerTestBase [main] Executing the command: docker exec 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:14:46.127-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:14:46.138-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:14:46.139-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:14:46.139-08:00 INFO DockerTestBase [main] Executing the command: docker exec 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:14:47.637-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:14:47.638-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:14:47.648-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:14:47.658-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:14:47.658-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:14:57.354-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56305] 2021-01-13T08:14:57.355-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56305 2021-01-13T08:14:57.451-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56320] 2021-01-13T08:15:02.649-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:15:03.508-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:15:03.509-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:15:05.048-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 426 } 2021-01-13T08:15:05.048-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 426 } 2021-01-13T08:15:06.451-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2955 } 2021-01-13T08:15:06.451-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 2955 } 2021-01-13T08:15:07.881-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4860 } 2021-01-13T08:15:07.881-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 4860 } 2021-01-13T08:15:09.094-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:15:09.095-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:15:09.095-08:00 INFO UpgradeFromAlice600ITD [main] Upgrading CBAS nodes ... 2021-01-13T08:15:09.096-08:00 INFO UpgradeTestBase [main] Recreating 'n2' node (image = null, forceNewIp = false)... 2021-01-13T08:15:09.096-08:00 INFO DockerTestBase [main] Copying files from docker container 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0005_n2_couchbase_enterprise-6.0.0 2021-01-13T08:15:09.398-08:00 INFO DockerTestBase [main] Stopping docker container: 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab 2021-01-13T08:15:09.969-08:00 INFO DockerTestBase [main] Stopped docker container: 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab 2021-01-13T08:15:09.970-08:00 INFO DockerTestBase [main] Removing docker container: 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab 2021-01-13T08:15:09.985-08:00 INFO DockerTestBase [main] Removed docker container: 843a637dad28cf1218975840c7b88a53358477052623ef78197dba39bb340fab 2021-01-13T08:15:09.986-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0007_n2_thisbuild, network = { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 }) 2021-01-13T08:15:11.172-08:00 INFO DockerTestBase [main] Container information for a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56346->192.168.176.3:8095, 172.17.0.1:56350->192.168.176.3:8091 2021-01-13T08:15:22.253-08:00 INFO UpgradeTestBase [main] Recreating 'n3' node (image = null, forceNewIp = false)... 2021-01-13T08:15:22.253-08:00 INFO DockerTestBase [main] Copying files from docker container 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0006_n3_couchbase_enterprise-6.0.0 2021-01-13T08:15:22.593-08:00 INFO DockerTestBase [main] Stopping docker container: 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5 2021-01-13T08:15:23.269-08:00 INFO DockerTestBase [main] Stopped docker container: 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5 2021-01-13T08:15:23.269-08:00 INFO DockerTestBase [main] Removing docker container: 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5 2021-01-13T08:15:23.280-08:00 INFO DockerTestBase [main] Removed docker container: 4ea3b23812be007104f1b2557ccbee6bdea2727340b2539a90e403f8f7af76f5 2021-01-13T08:15:23.281-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0008_n3_thisbuild, network = { name = cbas-docker-test-0002-fe363d26-9a7f-449b-8f8e-72e1da925386, id = 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 }) 2021-01-13T08:15:24.503-08:00 INFO DockerTestBase [main] Container information for b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56361->192.168.176.4:8095, 172.17.0.1:56365->192.168.176.4:8091 2021-01-13T08:15:36.763-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:15:54.192-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56350] 2021-01-13T08:15:54.193-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:15:55.513-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:15:55.514-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 2949 } 2021-01-13T08:15:56.746-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:15:56.747-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2949 } 2021-01-13T08:15:58.076-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:15:58.077-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 2949 } 2021-01-13T08:15:59.701-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3105 } 2021-01-13T08:15:59.702-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 3105 } 2021-01-13T08:16:01.274-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4189 } 2021-01-13T08:16:01.274-08:00 INFO DockerTestBase [main] Failed attempt number: 5. ResultSet found : { "$1": 4189 } 2021-01-13T08:16:02.671-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5736 } 2021-01-13T08:16:02.672-08:00 INFO DockerTestBase [main] Failed attempt number: 6. ResultSet found : { "$1": 5736 } 2021-01-13T08:16:03.870-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:16:03.871-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:16:03.872-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0004_n1_couchbase_enterprise-6.0.0 2021-01-13T08:16:03.883-08:00 INFO DockerTestBase [main] Copying files from docker container a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0007_n2_thisbuild 2021-01-13T08:16:03.887-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyOffline/0008_n3_thisbuild 2021-01-13T08:16:04.347-08:00 INFO DockerTestBase [main] Stopping docker container: a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16 2021-01-13T08:16:04.373-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 2021-01-13T08:16:04.770-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13 2021-01-13T08:16:05.027-08:00 INFO DockerTestBase [main] Stopped docker container: a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16 2021-01-13T08:16:05.230-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 2021-01-13T08:16:05.513-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13 2021-01-13T08:16:05.514-08:00 INFO DockerTestBase [main] Removing docker container: a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16 2021-01-13T08:16:05.515-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 2021-01-13T08:16:05.517-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13 2021-01-13T08:16:05.543-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 19744f7ed69a7aed04e07efe06d2afd69c5ccae0f87849b0a1b6f198396a0049 2021-01-13T08:16:05.553-08:00 INFO DockerTestBase [main] Removed docker container: a14d08df47cc06d83c19df7594d74b465e6c9982c5d86613d16fc788a5545b16 2021-01-13T08:16:05.559-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: b739b0325092ee500eae2f9a27b7417e11d237233d951d8f21b0d58c3befeb13 2021-01-13T08:16:05.559-08:00 INFO DockerTestBase [main] Removing docker network: 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 2021-01-13T08:16:05.648-08:00 INFO DockerTestBase [main] Removed docker network: 3affa50ab8012cfe5e633f3c6e86988f02e7f4a7703bb7970118ad383605bb51 2021-01-13T08:16:05.651-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyOffline SUCCEEDED 2021-01-13T08:16:05.652-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyCCNewMixedOffline START 2021-01-13T08:16:05.715-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98) 2021-01-13T08:16:05.774-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 } 2021-01-13T08:16:05.775-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #1 ... 2021-01-13T08:16:05.775-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:16:05.986-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:16:05.988-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0009_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 }) 2021-01-13T08:16:06.934-08:00 INFO DockerTestBase [main] Container information for ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56376->192.168.176.2:8095, 172.17.0.1:56380->192.168.176.2:8091 2021-01-13T08:16:18.983-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:16:18.983-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:16:19.596-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:16:19.609-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:16:19.610-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:16:20.095-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:16:20.105-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #2 ... 2021-01-13T08:16:20.106-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:16:20.125-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:16:20.126-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0010_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 }) 2021-01-13T08:16:21.039-08:00 INFO DockerTestBase [main] Container information for b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56391->192.168.176.3:8095, 172.17.0.1:56396->192.168.176.3:8091 2021-01-13T08:16:35.129-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:16:35.129-08:00 INFO DockerTestBase [main] Executing the command: docker exec b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:16:35.931-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:16:35.944-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:16:35.945-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:16:40.624-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:16:40.635-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:16:40.635-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:16:40.635-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:16:44.128-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:16:44.129-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:16:44.140-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:16:44.148-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:16:44.148-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #3 ... 2021-01-13T08:16:44.148-08:00 INFO UpgradeTestBase [main] Creating n3 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:16:44.174-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:16:44.176-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0011_n3_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 }) 2021-01-13T08:16:45.222-08:00 INFO DockerTestBase [main] Container information for ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56407->192.168.176.4:8095, 172.17.0.1:56411->192.168.176.4:8091 2021-01-13T08:16:58.602-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:16:58.602-08:00 INFO DockerTestBase [main] Executing the command: docker exec ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:16:59.517-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:16:59.529-08:00 INFO UpgradeFromAlice600ITD [main] Running server-add ... 2021-01-13T08:16:59.530-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:16:59.530-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:17:04.611-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:17:04.626-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:17:04.626-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:17:04.626-08:00 INFO DockerTestBase [main] Executing the command: docker exec ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:17:13.089-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:17:13.090-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:17:13.100-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:17:13.108-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:17:13.109-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:17:13.183-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56380] 2021-01-13T08:17:13.185-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56380 2021-01-13T08:17:13.270-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56396] 2021-01-13T08:17:18.371-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:17:19.295-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:17:19.295-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:17:21.149-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 503 } 2021-01-13T08:17:21.149-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 503 } 2021-01-13T08:17:22.494-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3338 } 2021-01-13T08:17:22.495-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3338 } 2021-01-13T08:17:23.688-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:17:23.689-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:17:23.690-08:00 INFO UpgradeTestBase [main] Recreating 'n2' node (image = null, forceNewIp = false)... 2021-01-13T08:17:23.690-08:00 INFO DockerTestBase [main] Copying files from docker container b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0010_n2_couchbase_enterprise-6.0.0 2021-01-13T08:17:23.957-08:00 INFO DockerTestBase [main] Stopping docker container: b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5 2021-01-13T08:17:24.507-08:00 INFO DockerTestBase [main] Stopped docker container: b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5 2021-01-13T08:17:24.508-08:00 INFO DockerTestBase [main] Removing docker container: b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5 2021-01-13T08:17:24.521-08:00 INFO DockerTestBase [main] Removed docker container: b5716960182bcf600cb75d9b70fd3bb5378fbdcdcc5302b8a19e25bad44d6eb5 2021-01-13T08:17:24.523-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0012_n2_thisbuild, network = { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 }) 2021-01-13T08:17:25.534-08:00 INFO DockerTestBase [main] Container information for 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56422->192.168.176.3:8095, 172.17.0.1:56426->192.168.176.3:8091 2021-01-13T08:17:35.823-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:17:46.467-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56426] 2021-01-13T08:17:46.468-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:17:47.795-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:17:47.796-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 2949 } 2021-01-13T08:17:48.973-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:17:48.974-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2949 } 2021-01-13T08:17:50.267-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2949 } 2021-01-13T08:17:50.268-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 2949 } 2021-01-13T08:17:51.761-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3534 } 2021-01-13T08:17:51.762-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 3534 } 2021-01-13T08:17:53.183-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5673 } 2021-01-13T08:17:53.184-08:00 INFO DockerTestBase [main] Failed attempt number: 5. ResultSet found : { "$1": 5673 } 2021-01-13T08:17:54.350-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:17:54.350-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:17:54.351-08:00 INFO UpgradeTestBase [main] Recreating 'n3' node (image = null, forceNewIp = false)... 2021-01-13T08:17:54.351-08:00 INFO DockerTestBase [main] Copying files from docker container ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0011_n3_couchbase_enterprise-6.0.0 2021-01-13T08:17:54.642-08:00 INFO DockerTestBase [main] Stopping docker container: ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520 2021-01-13T08:17:55.181-08:00 INFO DockerTestBase [main] Stopped docker container: ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520 2021-01-13T08:17:55.181-08:00 INFO DockerTestBase [main] Removing docker container: ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520 2021-01-13T08:17:55.196-08:00 INFO DockerTestBase [main] Removed docker container: ab169463b00cf9249ebd1dfd08405b8dd57a9f7899d620ff54db36c3c263b520 2021-01-13T08:17:55.197-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0013_n3_thisbuild, network = { name = cbas-docker-test-0003-9f2a52b5-474c-4472-9d87-2de55bb26e98, id = 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 }) 2021-01-13T08:17:56.262-08:00 INFO DockerTestBase [main] Container information for cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56437->192.168.176.4:8095, 172.17.0.1:56441->192.168.176.4:8091 2021-01-13T08:18:07.451-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:18:16.724-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56441] 2021-01-13T08:18:16.724-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:18:18.398-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:18:18.398-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:18:18.399-08:00 INFO DockerTestBase [main] Copying files from docker container 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0012_n2_thisbuild 2021-01-13T08:18:18.401-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0009_n1_couchbase_enterprise-6.0.0 2021-01-13T08:18:18.401-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Copying files from docker container cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCNewMixedOffline/0013_n3_thisbuild 2021-01-13T08:18:18.921-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 2021-01-13T08:18:18.947-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopping docker container: cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2 2021-01-13T08:18:19.395-08:00 INFO DockerTestBase [main] Stopping docker container: 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a 2021-01-13T08:18:19.657-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 2021-01-13T08:18:19.983-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopped docker container: cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2 2021-01-13T08:18:20.191-08:00 INFO DockerTestBase [main] Stopped docker container: 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a 2021-01-13T08:18:20.192-08:00 INFO DockerTestBase [main] Removing docker container: 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a 2021-01-13T08:18:20.195-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2 2021-01-13T08:18:20.199-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 2021-01-13T08:18:20.211-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: cf2e1cecb1f56b0362aa7c97f19bf6bb0cf0857c78d178957f76e683f2d512b2 2021-01-13T08:18:20.211-08:00 INFO DockerTestBase [main] Removed docker container: 5050fd2113cd5b31023a94d4ca6004d2b0d8474feb1efeebdd1061a5eb9d5c1a 2021-01-13T08:18:20.241-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: ea7407198446a29bbdb6792f6de69d9efe6db511107d52e1896f61c333d20872 2021-01-13T08:18:20.242-08:00 INFO DockerTestBase [main] Removing docker network: 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 2021-01-13T08:18:20.326-08:00 INFO DockerTestBase [main] Removed docker network: 35bd3e5a53773c2a7f32936c07d48ef7727b607434d97dc76c55705029c28f15 2021-01-13T08:18:20.328-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyCCNewMixedOffline SUCCEEDED 2021-01-13T08:18:20.330-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyCCOldMixedOffline START 2021-01-13T08:18:20.391-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7) 2021-01-13T08:18:20.452-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c } 2021-01-13T08:18:20.453-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #1 ... 2021-01-13T08:18:20.453-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:18:20.533-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:18:20.534-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0014_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c }) 2021-01-13T08:18:21.465-08:00 INFO DockerTestBase [main] Container information for bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56452->192.168.176.2:8095, 172.17.0.1:56456->192.168.176.2:8091 2021-01-13T08:18:33.727-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:18:33.727-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:18:34.576-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:18:34.588-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:18:34.589-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:18:35.050-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:18:35.063-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #2 ... 2021-01-13T08:18:35.063-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:18:35.084-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:18:35.085-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0015_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c }) 2021-01-13T08:18:36.020-08:00 INFO DockerTestBase [main] Container information for 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56467->192.168.176.3:8095, 172.17.0.1:56471->192.168.176.3:8091 2021-01-13T08:18:49.087-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:18:49.087-08:00 INFO DockerTestBase [main] Executing the command: docker exec 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:18:50.009-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:18:50.020-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:18:50.021-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:18:55.050-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:18:55.062-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:18:55.063-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:18:55.063-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:18:58.553-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:18:58.554-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:18:58.564-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:18:58.571-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:18:58.571-08:00 INFO UpgradeFromAlice600ITD [main] Creating node #3 ... 2021-01-13T08:18:58.571-08:00 INFO UpgradeTestBase [main] Creating n3 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:18:58.589-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:18:58.590-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0016_n3_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c }) 2021-01-13T08:18:59.712-08:00 INFO DockerTestBase [main] Container information for 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56482->192.168.176.4:8095, 172.17.0.1:56486->192.168.176.4:8091 2021-01-13T08:19:14.786-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:19:14.786-08:00 INFO DockerTestBase [main] Executing the command: docker exec 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:19:15.636-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:19:15.648-08:00 INFO UpgradeFromAlice600ITD [main] Running server-add ... 2021-01-13T08:19:15.648-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:19:15.649-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:19:20.392-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:19:20.401-08:00 INFO UpgradeFromAlice600ITD [main] Rebalancing ... 2021-01-13T08:19:20.402-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:19:20.402-08:00 INFO DockerTestBase [main] Executing the command: docker exec bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:19:28.905-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:19:28.905-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:19:28.914-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:19:28.921-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:19:28.922-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:19:28.993-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56456] 2021-01-13T08:19:28.993-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56456 2021-01-13T08:19:29.094-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56471] 2021-01-13T08:19:33.729-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:19:34.738-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:19:34.739-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:19:36.707-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 569 } 2021-01-13T08:19:36.709-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 569 } 2021-01-13T08:19:38.253-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3095 } 2021-01-13T08:19:38.253-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3095 } 2021-01-13T08:19:39.682-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5754 } 2021-01-13T08:19:39.683-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 5754 } 2021-01-13T08:19:40.903-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:19:40.903-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:19:40.904-08:00 INFO UpgradeTestBase [main] Recreating 'n3' node (image = null, forceNewIp = false)... 2021-01-13T08:19:40.904-08:00 INFO DockerTestBase [main] Copying files from docker container 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0016_n3_couchbase_enterprise-6.0.0 2021-01-13T08:19:41.158-08:00 INFO DockerTestBase [main] Stopping docker container: 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a 2021-01-13T08:19:41.704-08:00 INFO DockerTestBase [main] Stopped docker container: 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a 2021-01-13T08:19:41.705-08:00 INFO DockerTestBase [main] Removing docker container: 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a 2021-01-13T08:19:41.717-08:00 INFO DockerTestBase [main] Removed docker container: 2d69ea3f979eda4ec4fddc66954ebb288338dd2846c63841ec020d4da3321b5a 2021-01-13T08:19:41.719-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0017_n3_thisbuild, network = { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c }) 2021-01-13T08:19:42.739-08:00 INFO DockerTestBase [main] Container information for b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56497->192.168.176.4:8095, 172.17.0.1:56501->192.168.176.4:8091 2021-01-13T08:19:53.785-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:20:02.281-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56501] 2021-01-13T08:20:02.282-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:20:03.440-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2942 } 2021-01-13T08:20:03.440-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 2942 } 2021-01-13T08:20:04.980-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4256 } 2021-01-13T08:20:04.980-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 4256 } 2021-01-13T08:20:06.242-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4503 } 2021-01-13T08:20:06.243-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 4503 } 2021-01-13T08:20:07.438-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:20:07.439-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:20:07.439-08:00 INFO UpgradeTestBase [main] Recreating 'n2' node (image = null, forceNewIp = false)... 2021-01-13T08:20:07.440-08:00 INFO DockerTestBase [main] Copying files from docker container 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0015_n2_couchbase_enterprise-6.0.0 2021-01-13T08:20:07.769-08:00 INFO DockerTestBase [main] Stopping docker container: 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a 2021-01-13T08:20:08.702-08:00 INFO DockerTestBase [main] Stopped docker container: 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a 2021-01-13T08:20:08.702-08:00 INFO DockerTestBase [main] Removing docker container: 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a 2021-01-13T08:20:08.784-08:00 INFO DockerTestBase [main] Removed docker container: 1325718e4d53421bf70708e088c6f32aef44279e41954cb8331b428f9b8b1f9a 2021-01-13T08:20:08.786-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0018_n2_thisbuild, network = { name = cbas-docker-test-0004-276c3faa-3115-4697-81aa-96370b6e4ad7, id = 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c }) 2021-01-13T08:20:09.991-08:00 INFO DockerTestBase [main] Container information for 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56512->192.168.176.3:8095, 172.17.0.1:56516->192.168.176.3:8091 2021-01-13T08:20:20.032-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:20:31.744-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56516] 2021-01-13T08:20:31.744-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:20:32.862-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:20:32.863-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:20:32.864-08:00 INFO DockerTestBase [main] Copying files from docker container b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0017_n3_thisbuild 2021-01-13T08:20:32.864-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0018_n2_thisbuild 2021-01-13T08:20:32.868-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Copying files from docker container bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeToCheckoutCBASOnlyCCOldMixedOffline/0014_n1_couchbase_enterprise-6.0.0 2021-01-13T08:20:33.306-08:00 INFO DockerTestBase [main] Stopping docker container: b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e 2021-01-13T08:20:33.328-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c 2021-01-13T08:20:33.712-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopping docker container: bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 2021-01-13T08:20:33.905-08:00 INFO DockerTestBase [main] Stopped docker container: b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e 2021-01-13T08:20:34.266-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c 2021-01-13T08:20:34.362-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopped docker container: bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 2021-01-13T08:20:34.363-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removing docker container: bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 2021-01-13T08:20:34.363-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c 2021-01-13T08:20:34.364-08:00 INFO DockerTestBase [main] Removing docker container: b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e 2021-01-13T08:20:34.375-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 80307453277b34a6de8510e9616af6a0c4b62209fb17c250fae6c7579316544c 2021-01-13T08:20:34.377-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removed docker container: bdcb35a8a4fca6c57aca6b7a4971f45a13b4d982f6258ee5c0b95f2938217a74 2021-01-13T08:20:34.385-08:00 INFO DockerTestBase [main] Removed docker container: b9fca00a80173b2d42bd7dc362d81348f642153391cf2cea34839cb8b202d93e 2021-01-13T08:20:34.386-08:00 INFO DockerTestBase [main] Removing docker network: 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c 2021-01-13T08:20:34.450-08:00 INFO DockerTestBase [main] Removed docker network: 53f064e73f1fcd89e0f79f42d3dbc12d83a625c17719cec9e8d3b2f2a866619c 2021-01-13T08:20:34.453-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyCCOldMixedOffline SUCCEEDED 2021-01-13T08:20:34.454-08:00 WARN TestMethodTracer [main] ### upgradeEnsureTxnLog START 2021-01-13T08:20:34.528-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53) 2021-01-13T08:20:34.590-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e } 2021-01-13T08:20:34.591-08:00 INFO UpgradeTestBase [main] Creating kv node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:20:34.595-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001kv to /opt/couchbase/var 2021-01-13T08:20:34.596-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0019_kv_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e }) 2021-01-13T08:20:35.457-08:00 INFO DockerTestBase [main] Container information for ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1: host: kv.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56527->192.168.176.2:8095, 172.17.0.1:56531->192.168.176.2:8091 2021-01-13T08:20:47.499-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv (192.168.176.2) 2021-01-13T08:20:47.499-08:00 INFO DockerTestBase [main] Executing the command: docker exec ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname kv.couchbase.host 2021-01-13T08:20:48.096-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:20:48.108-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node kv (192.168.176.2) with services: [DATA] 2021-01-13T08:20:48.108-08:00 INFO DockerTestBase [main] Executing the command: docker exec ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:20:48.611-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:20:48.624-08:00 INFO UpgradeTestBase [main] Creating cbas node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:20:48.625-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas to /opt/couchbase/var 2021-01-13T08:20:48.625-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0020_cbas_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e }) 2021-01-13T08:20:49.579-08:00 INFO DockerTestBase [main] Container information for acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad: host: cbas.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56542->192.168.176.3:8095, 172.17.0.1:56546->192.168.176.3:8091 2021-01-13T08:21:01.819-08:00 INFO DockerTestBase [main] Running 'node-init' on node cbas (192.168.176.3) 2021-01-13T08:21:01.819-08:00 INFO DockerTestBase [main] Executing the command: docker exec acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname cbas.couchbase.host 2021-01-13T08:21:02.513-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:21:02.525-08:00 INFO DockerTestBase [main] Running 'server-add' for node cbas (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:21:02.525-08:00 INFO DockerTestBase [main] Executing the command: docker exec ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://cbas.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:21:07.225-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:21:07.236-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:21:07.236-08:00 INFO DockerTestBase [main] Executing the command: docker exec ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:21:11.754-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:21:11.754-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:21:11.766-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:21:11.772-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:21:11.772-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:21:20.193-08:00 INFO UpgradeFromAlice600ITD [main] Swap-rebalancing KV node ... 2021-01-13T08:21:20.193-08:00 INFO UpgradeTestBase [main] Creating kv-new node using 'this build' docker image... 2021-01-13T08:21:20.193-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003kvnew to /opt/couchbase/var 2021-01-13T08:21:20.194-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0021_kvnew_thisbuild, network = { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e }) 2021-01-13T08:21:21.269-08:00 INFO DockerTestBase [main] Container information for 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540: host: kvnew.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56557->192.168.176.4:8095, 172.17.0.1:56561->192.168.176.4:8091 2021-01-13T08:21:32.313-08:00 INFO DockerTestBase [main] Running 'node-init' on node kvnew (192.168.176.4) 2021-01-13T08:21:32.313-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname kvnew.couchbase.host 2021-01-13T08:21:33.520-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:21:33.574-08:00 INFO DockerTestBase [main] Running 'server-add' for node kvnew (192.168.176.4) with services: [DATA] 2021-01-13T08:21:33.575-08:00 INFO DockerTestBase [main] Executing the command: docker exec acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://kvnew.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:21:38.087-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:21:38.099-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:21:38.101-08:00 INFO DockerTestBase [main] Executing the command: docker exec acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove kv.couchbase.host 2021-01-13T08:21:52.204-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:21:52.204-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:21:52.215-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56561] 2021-01-13T08:21:52.216-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56561 2021-01-13T08:21:53.321-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56546] 2021-01-13T08:21:54.848-08:00 INFO UpgradeFromAlice600ITD [main] Creating magic bucket... 2021-01-13T08:21:54.864-08:00 INFO KvStoreHttpHelper [main] Bucket (magic_bucket) does not exist. 2021-01-13T08:21:54.883-08:00 INFO KvStoreHttpHelper [main] Bucket (magic_bucket) created successfully. 2021-01-13T08:21:55.071-08:00 INFO UpgradeFromAlice600ITD [main] Creating magic dataset... 2021-01-13T08:21:55.414-08:00 INFO UpgradeFromAlice600ITD [main] Creating magic index... 2021-01-13T08:21:55.764-08:00 INFO UpgradeTestBase [main] Connecting link... 2021-01-13T08:21:59.996-08:00 INFO UpgradeFromAlice600ITD [main] Waiting for magic bucket to be ingested... 2021-01-13T08:22:00.729-08:00 INFO DockerTestBase [main] ResultSet found : { "cnt": 0 } 2021-01-13T08:22:00.729-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:22:00.729-08:00 INFO UpgradeFromAlice600ITD [main] Ingesting magic nulls into magic bucket... 2021-01-13T08:22:00.831-08:00 INFO UpgradeFromAlice600ITD [main] Waiting for magic bucket to be ingested... 2021-01-13T08:22:00.980-08:00 INFO DockerTestBase [main] ResultSet found : { "cnt": 0 } 2021-01-13T08:22:00.981-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "cnt": 0 } 2021-01-13T08:22:02.213-08:00 INFO DockerTestBase [main] ResultSet found : { "cnt": 0 } 2021-01-13T08:22:02.213-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "cnt": 0 } 2021-01-13T08:22:03.397-08:00 INFO DockerTestBase [main] ResultSet found : { "cnt": 3 } 2021-01-13T08:22:03.397-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:22:03.397-08:00 INFO UpgradeFromAlice600ITD [main] Killing node (should ensure txn log) ... 2021-01-13T08:22:03.397-08:00 INFO DockerTestBase [main] Copying files from docker container acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0020_cbas_couchbase_enterprise-6.0.0 2021-01-13T08:22:03.672-08:00 INFO DockerTestBase [main] Stopping docker container: acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad 2021-01-13T08:22:04.188-08:00 INFO DockerTestBase [main] Stopped docker container: acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad 2021-01-13T08:22:04.188-08:00 INFO DockerTestBase [main] Removing docker container: acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad 2021-01-13T08:22:04.200-08:00 INFO DockerTestBase [main] Removed docker container: acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad 2021-01-13T08:22:04.201-08:00 INFO UpgradeFromAlice600ITD [main] Backing up pre-upgrade state ... 2021-01-13T08:22:04.271-08:00 INFO UpgradeFromAlice600ITD [main] Upgrading node ... 2021-01-13T08:22:04.273-08:00 INFO UpgradeTestBase [main] Recreating 'cbas' node (image = null, forceNewIp = false)... 2021-01-13T08:22:04.273-08:00 INFO DockerTestBase [main] Not stopping docker container acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad (not running) 2021-01-13T08:22:04.273-08:00 INFO DockerTestBase [main] Not removing already removed docker container acaa475bcb5e4be1d5804f1c2145d9f21b672c448a6977f9d171540b4f588cad 2021-01-13T08:22:04.274-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0022_cbas_thisbuild, network = { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e }) 2021-01-13T08:22:05.272-08:00 INFO DockerTestBase [main] Container information for 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35: host: cbas.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56572->192.168.176.3:8095, 172.17.0.1:56576->192.168.176.3:8091 2021-01-13T08:22:15.732-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE,REBALANCE_REQUIRED} for up to 120s... 2021-01-13T08:22:42.731-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:22:43.009-08:00 INFO UpgradeFromAlice600ITD [main] Killing & removing node now that clusterCompat has been updated ... 2021-01-13T08:22:43.010-08:00 INFO DockerTestBase [main] Copying files from docker container 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0022_cbas_thisbuild 2021-01-13T08:22:43.434-08:00 INFO DockerTestBase [main] Stopping docker container: 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 2021-01-13T08:22:43.994-08:00 INFO DockerTestBase [main] Stopped docker container: 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 2021-01-13T08:22:43.994-08:00 INFO DockerTestBase [main] Removing docker container: 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 2021-01-13T08:22:44.009-08:00 INFO DockerTestBase [main] Removed docker container: 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 2021-01-13T08:22:44.009-08:00 INFO UpgradeFromAlice600ITD [main] Restoring pre-upgrade state ... 2021-01-13T08:22:44.101-08:00 INFO UpgradeTestBase [main] Recreating 'cbas' node (image = null, forceNewIp = false)... 2021-01-13T08:22:44.101-08:00 INFO DockerTestBase [main] Not stopping docker container 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 (not running) 2021-01-13T08:22:44.101-08:00 INFO DockerTestBase [main] Not removing already removed docker container 766de32dfec97c52a61209e0a4d4ed6c09334846af8f0cf2183edf4f37e0ff35 2021-01-13T08:22:44.102-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0023_cbas_thisbuild, network = { name = cbas-docker-test-0005-1ab3ad05-eb91-40dd-9f43-dfb960fc3a53, id = 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e }) 2021-01-13T08:22:44.997-08:00 INFO DockerTestBase [main] Container information for 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8: host: cbas.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56587->192.168.176.3:8095, 172.17.0.1:56591->192.168.176.3:8091 2021-01-13T08:22:57.048-08:00 INFO UpgradeFromAlice600ITD [main] Waiting for REBALANCE_REQUIRED ... 2021-01-13T08:22:57.048-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {REBALANCE_REQUIRED} for up to 120s... 2021-01-13T08:23:07.799-08:00 INFO UpgradeFromAlice600ITD [main] Running required rebalance ... 2021-01-13T08:23:07.799-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:23:07.799-08:00 INFO DockerTestBase [main] Executing the command: docker exec 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase 2021-01-13T08:23:18.661-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:23:18.662-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:23:18.769-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:23:18.777-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:23:18.777-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:23:20.079-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:23:45.165-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56591] 2021-01-13T08:23:48.523-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:23:49.191-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1896 } 2021-01-13T08:23:49.192-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 1896 } 2021-01-13T08:23:50.422-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1992 } 2021-01-13T08:23:50.423-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 1992 } 2021-01-13T08:23:51.686-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3686 } 2021-01-13T08:23:51.686-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3686 } 2021-01-13T08:23:52.875-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:23:52.875-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:23:52.875-08:00 INFO UpgradeFromAlice600ITD [main] Waiting for magic bucket to be ingested... 2021-01-13T08:23:53.040-08:00 INFO DockerTestBase [main] ResultSet found : { "cnt": 3 } 2021-01-13T08:23:53.040-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:23:53.041-08:00 INFO UpgradeFromAlice600ITD [main] Checking no nulls in secondary index... 2021-01-13T08:23:53.178-08:00 INFO DockerTestBase [main] Copying files from docker container 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0023_cbas_thisbuild 2021-01-13T08:23:53.756-08:00 INFO DockerTestBase [main] Stopping docker container: 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8 2021-01-13T08:23:54.284-08:00 INFO DockerTestBase [main] Stopped docker container: 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8 2021-01-13T08:23:54.297-08:00 INFO DockerTestBase [main] found 2 occurrences of 'Logs REDO phase completed' in analytics_info.log on cbas (192.168.176.3) 2021-01-13T08:23:54.299-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0019_kv_couchbase_enterprise-6.0.0 2021-01-13T08:23:54.301-08:00 INFO DockerTestBase [main] Copying files from docker container 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD/upgradeEnsureTxnLog/0021_kvnew_thisbuild 2021-01-13T08:23:54.577-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 2021-01-13T08:23:55.202-08:00 INFO DockerTestBase [main] Stopping docker container: 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540 2021-01-13T08:23:55.319-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 2021-01-13T08:23:55.691-08:00 INFO DockerTestBase [main] Stopped docker container: 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540 2021-01-13T08:23:55.693-08:00 INFO DockerTestBase [main] Removing docker container: 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540 2021-01-13T08:23:55.697-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 2021-01-13T08:23:55.697-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8 2021-01-13T08:23:55.712-08:00 INFO DockerTestBase [main] Removed docker container: 9e76ebd9d5edcaf4b82c4bde62c894e4ff91fedcb8024a6a28cb59f5769ac540 2021-01-13T08:23:55.721-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: ab9d54dcc0d56a409255364de6617cdb4931fae20129a65d1c5b4db35cf6dfe1 2021-01-13T08:23:55.723-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 6c8f352e6de33801b780296570dd88de15c20e66bffa752807c8d040c15a46f8 2021-01-13T08:23:55.724-08:00 INFO DockerTestBase [main] Removing docker network: 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e 2021-01-13T08:23:55.797-08:00 INFO DockerTestBase [main] Removed docker network: 139deaf9e6f08888bd107e810bd0a99018ec9b7fd785ef52f89e7a2418265c8e 2021-01-13T08:23:55.800-08:00 WARN TestMethodTracer [main] ### upgradeEnsureTxnLog SUCCEEDED [INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 694.015 s - in com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600ITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD 2021-01-13 08:23:58,669 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:23:58.799-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:23:58.828-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:23:58.828-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:23:59.437-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.0.0 2021-01-13T08:24:00.608-08:00 INFO DockerTestBase [main+] >> enterprise-6.0.0: Pulling from library/couchbase 2021-01-13T08:24:00.826-08:00 INFO DockerTestBase [main+] >> Digest: sha256:342fb755176fb28c826b705721d69eb0fbba8631fd41f3a103806c235bbc6760 2021-01-13T08:24:00.827-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-6.0.0 2021-01-13T08:24:00.856-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.0.0 2021-01-13T08:24:00.868-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyOnline START 2021-01-13T08:24:02.605-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141) 2021-01-13T08:24:02.732-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d } 2021-01-13T08:24:02.735-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:24:02.738-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:24:02.743-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0001_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d }) 2021-01-13T08:24:03.873-08:00 INFO DockerTestBase [main] Container information for 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56606->192.168.176.2:8091, 172.17.0.1:56602->192.168.176.2:8095 2021-01-13T08:24:16.266-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:24:16.268-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:24:17.063-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:24:17.079-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:24:17.080-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:24:17.595-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:24:17.608-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:24:17.609-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:24:17.609-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0002_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d }) 2021-01-13T08:24:18.622-08:00 INFO DockerTestBase [main] Container information for 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56621->192.168.176.3:8091, 172.17.0.1:56617->192.168.176.3:8095 2021-01-13T08:24:31.695-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:24:31.696-08:00 INFO DockerTestBase [main] Executing the command: docker exec 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:24:32.529-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:24:32.541-08:00 INFO UpgradeTestBase [main] Creating n3 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:24:32.541-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:24:32.542-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0003_n3_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d }) 2021-01-13T08:24:33.601-08:00 INFO DockerTestBase [main] Container information for cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56636->192.168.176.4:8091, 172.17.0.1:56632->192.168.176.4:8095 2021-01-13T08:24:46.673-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:24:46.673-08:00 INFO DockerTestBase [main] Executing the command: docker exec cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:24:47.498-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:24:47.509-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:24:47.511-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:24:52.724-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:24:52.738-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:24:52.738-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:24:57.716-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:24:57.727-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:24:57.728-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:24:59.148-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:24:59.148-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:24:59.186-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:24:59.215-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:24:59.233-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:25:09.186-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56606] 2021-01-13T08:25:09.193-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56606 2021-01-13T08:25:09.314-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56621] 2021-01-13T08:25:14.773-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:25:15.579-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:25:15.597-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:25:17.225-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 968 } 2021-01-13T08:25:17.226-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 968 } 2021-01-13T08:25:18.588-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3226 } 2021-01-13T08:25:18.589-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3226 } 2021-01-13T08:25:19.923-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5675 } 2021-01-13T08:25:19.924-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 5675 } 2021-01-13T08:25:21.174-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:25:21.175-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:25:21.175-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T08:25:21.177-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n2new to /opt/couchbase/var 2021-01-13T08:25:21.178-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:25:21.285-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:25:21.289-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:25:21.289-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:25:21.293-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:25:21.298-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0004_n2new_thisbuild, network = { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d }) 2021-01-13T08:25:22.475-08:00 INFO DockerTestBase [main] Container information for e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5: host: n2new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:56651->192.168.176.5:8091, 172.17.0.1:56647->192.168.176.5:8095 2021-01-13T08:25:32.893-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.5) 2021-01-13T08:25:32.894-08:00 INFO DockerTestBase [main] Executing the command: docker exec e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T08:25:34.170-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:25:34.218-08:00 INFO UpgradeTestBase [main] Creating n3-new node using 'this build' docker image... 2021-01-13T08:25:34.219-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0005n3new to /opt/couchbase/var 2021-01-13T08:25:34.220-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0005_n3new_thisbuild, network = { name = cbas-docker-test-0001-61a64f2a-70b1-4354-baac-4e43c1a75141, id = e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d }) 2021-01-13T08:25:35.375-08:00 INFO DockerTestBase [main] Container information for e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899: host: n3new.couchbase.host, ip: 192.168.176.6, 172.17.0.1:56666->192.168.176.6:8091, 172.17.0.1:56662->192.168.176.6:8095 2021-01-13T08:25:47.436-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3new (192.168.176.6) 2021-01-13T08:25:47.437-08:00 INFO DockerTestBase [main] Executing the command: docker exec e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.6:8091 -u couchbase -p couchbase --node-init-hostname n3new.couchbase.host 2021-01-13T08:25:48.814-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:25:48.854-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.5) with services: [ANALYTICS] 2021-01-13T08:25:48.855-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:25:54.317-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:25:54.328-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3new (192.168.176.6) with services: [ANALYTICS] 2021-01-13T08:25:54.329-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:25:59.500-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:25:59.513-08:00 INFO UpgradeFromAlice600OnlineITD [main] Swap rebalancing ... 2021-01-13T08:25:59.513-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:25:59.515-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host,n3.couchbase.host 2021-01-13T08:26:32.871-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:26:32.871-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:26:32.894-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:26:32.895-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:26:49.839-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56651] 2021-01-13T08:26:49.839-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56666] 2021-01-13T08:26:49.839-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:26:49.839-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:26:51.440-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:26:51.440-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:26:51.458-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:26:51.458-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:26:51.464-08:00 INFO DockerTestBase [main] Copying files from docker container cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0003_n3_couchbase_enterprise-6.0.0 2021-01-13T08:26:51.465-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0002_n2_couchbase_enterprise-6.0.0 2021-01-13T08:26:51.466-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0005_n3new_thisbuild 2021-01-13T08:26:51.471-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0001_n1_couchbase_enterprise-6.0.0 2021-01-13T08:26:51.924-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c 2021-01-13T08:26:51.924-08:00 INFO DockerTestBase [main] Stopping docker container: cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1 2021-01-13T08:26:52.260-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899 2021-01-13T08:26:52.333-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a 2021-01-13T08:26:52.924-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c 2021-01-13T08:26:52.925-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyOnline/0004_n2new_thisbuild 2021-01-13T08:26:53.022-08:00 INFO DockerTestBase [main] Stopped docker container: cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1 2021-01-13T08:26:53.943-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899 2021-01-13T08:26:54.018-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a 2021-01-13T08:26:54.297-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5 2021-01-13T08:26:54.779-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5 2021-01-13T08:26:54.782-08:00 INFO DockerTestBase [main] Removing docker container: cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1 2021-01-13T08:26:54.782-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c 2021-01-13T08:26:54.783-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a 2021-01-13T08:26:54.783-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899 2021-01-13T08:26:54.802-08:00 INFO DockerTestBase [main] Removed docker container: cb83206ce336bce3d8131e80dea9344d54a6fad3fa31d0b216fba6a6c310f7b1 2021-01-13T08:26:54.807-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: 9d1e609e1a1ae16571f731b45cab2b0e98ee2e0cc86cf51204eca923a6f32c2a 2021-01-13T08:26:54.808-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5 2021-01-13T08:26:54.816-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 463a85ad4f6b45c57550730aea862738cfdd4f5f941b31ed1e64b891c06aa25c 2021-01-13T08:26:54.827-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: e4038809746db38974f67e952ffdd19558e3c720f3b77b52178bb1c2a02d1899 2021-01-13T08:26:54.827-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: e96907faafc1daf4473ddefc09fb5492b35504afa629df4bf5b903997c17fed5 2021-01-13T08:26:54.829-08:00 INFO DockerTestBase [main] Removing docker network: e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d 2021-01-13T08:26:54.913-08:00 INFO DockerTestBase [main] Removed docker network: e3c39da6e7ed7a9b82add9378e9f22409e16e235a38a48ed8b9534b1e224a77d 2021-01-13T08:26:54.923-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyOnline SUCCEEDED 2021-01-13T08:26:54.925-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyMixedOnline START 2021-01-13T08:26:55.010-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900) 2021-01-13T08:26:55.072-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 } 2021-01-13T08:26:55.073-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:26:55.165-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:26:55.167-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0006_n1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 }) 2021-01-13T08:26:56.268-08:00 INFO DockerTestBase [main] Container information for 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56681->192.168.176.2:8091, 172.17.0.1:56677->192.168.176.2:8095 2021-01-13T08:27:09.324-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:27:09.324-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:27:10.084-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:27:10.096-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:27:10.097-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:27:10.598-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:27:10.612-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:27:10.622-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:27:10.623-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0007_n2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 }) 2021-01-13T08:27:11.607-08:00 INFO DockerTestBase [main] Container information for cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56696->192.168.176.3:8091, 172.17.0.1:56692->192.168.176.3:8095 2021-01-13T08:27:23.662-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:27:23.663-08:00 INFO DockerTestBase [main] Executing the command: docker exec cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:27:24.422-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:27:24.433-08:00 INFO UpgradeTestBase [main] Creating n3 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:27:24.445-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:27:24.447-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0008_n3_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 }) 2021-01-13T08:27:25.552-08:00 INFO DockerTestBase [main] Container information for f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56711->192.168.176.4:8091, 172.17.0.1:56707->192.168.176.4:8095 2021-01-13T08:27:38.629-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:27:38.630-08:00 INFO DockerTestBase [main] Executing the command: docker exec f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:27:39.387-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:27:39.397-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:27:39.397-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:27:44.611-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:27:44.625-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:27:44.625-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:27:48.927-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:27:48.938-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:27:48.938-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:27:50.314-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:27:50.315-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:27:50.327-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:27:50.335-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:27:50.335-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:27:59.195-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56681] 2021-01-13T08:27:59.196-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56681 2021-01-13T08:27:59.304-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56696] 2021-01-13T08:28:04.062-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:28:04.926-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:28:04.926-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:28:06.528-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 274 } 2021-01-13T08:28:06.529-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 274 } 2021-01-13T08:28:08.317-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2937 } 2021-01-13T08:28:08.317-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 2937 } 2021-01-13T08:28:09.609-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:28:09.610-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:28:09.610-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T08:28:09.644-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n2new to /opt/couchbase/var 2021-01-13T08:28:09.645-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0009_n2new_thisbuild, network = { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 }) 2021-01-13T08:28:10.807-08:00 INFO DockerTestBase [main] Container information for 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab: host: n2new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:56726->192.168.176.5:8091, 172.17.0.1:56722->192.168.176.5:8095 2021-01-13T08:28:22.861-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.5) 2021-01-13T08:28:22.862-08:00 INFO DockerTestBase [main] Executing the command: docker exec 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T08:28:24.187-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:28:24.219-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.5) with services: [ANALYTICS] 2021-01-13T08:28:24.219-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:28:28.767-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:28:28.779-08:00 INFO UpgradeFromAlice600OnlineITD [main] Swap rebalancing ... 2021-01-13T08:28:28.780-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:28:28.780-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host 2021-01-13T08:28:55.194-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:28:55.194-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:28:55.208-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:28:55.323-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56726] 2021-01-13T08:28:55.323-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:28:56.111-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:28:56.111-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:28:56.111-08:00 INFO UpgradeTestBase [main] Creating n3-new node using 'this build' docker image... 2021-01-13T08:28:56.132-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0005n3new to /opt/couchbase/var 2021-01-13T08:28:56.133-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0010_n3new_thisbuild, network = { name = cbas-docker-test-0002-bd18af1f-ef9c-4153-a64b-dc4a36475900, id = 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 }) 2021-01-13T08:28:57.299-08:00 INFO DockerTestBase [main] Container information for 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a: host: n3new.couchbase.host, ip: 192.168.176.6, 172.17.0.1:56741->192.168.176.6:8091, 172.17.0.1:56737->192.168.176.6:8095 2021-01-13T08:29:08.713-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3new (192.168.176.6) 2021-01-13T08:29:08.713-08:00 INFO DockerTestBase [main] Executing the command: docker exec 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.6:8091 -u couchbase -p couchbase --node-init-hostname n3new.couchbase.host 2021-01-13T08:29:09.916-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:29:09.965-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3new (192.168.176.6) with services: [ANALYTICS] 2021-01-13T08:29:09.965-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:29:14.275-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:29:14.284-08:00 INFO UpgradeFromAlice600OnlineITD [main] Swap rebalancing ... 2021-01-13T08:29:14.284-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:29:14.284-08:00 INFO DockerTestBase [main] Executing the command: docker exec 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove n3.couchbase.host 2021-01-13T08:29:28.797-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:29:28.797-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:29:28.829-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:29:42.469-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56741] 2021-01-13T08:29:42.469-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:29:43.719-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:29:43.719-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:29:43.720-08:00 INFO DockerTestBase [main] Copying files from docker container f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0008_n3_couchbase_enterprise-6.0.0 2021-01-13T08:29:43.731-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0007_n2_couchbase_enterprise-6.0.0 2021-01-13T08:29:43.731-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0006_n1_couchbase_enterprise-6.0.0 2021-01-13T08:29:43.737-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Copying files from docker container 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0010_n3new_thisbuild 2021-01-13T08:29:44.116-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a 2021-01-13T08:29:44.144-08:00 INFO DockerTestBase [main] Stopping docker container: f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34 2021-01-13T08:29:44.513-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopping docker container: 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a 2021-01-13T08:29:44.571-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f 2021-01-13T08:29:45.368-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a 2021-01-13T08:29:45.369-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeToCheckoutCBASOnlyMixedOnline/0009_n2new_thisbuild 2021-01-13T08:29:45.444-08:00 INFO DockerTestBase [main] Stopped docker container: f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34 2021-01-13T08:29:46.094-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Stopped docker container: 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a 2021-01-13T08:29:46.184-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f 2021-01-13T08:29:46.459-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab 2021-01-13T08:29:46.926-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab 2021-01-13T08:29:46.927-08:00 INFO DockerTestBase [main] Removing docker container: f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34 2021-01-13T08:29:46.928-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a 2021-01-13T08:29:46.928-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removing docker container: 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab 2021-01-13T08:29:46.928-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a 2021-01-13T08:29:46.941-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removed docker container: 8ba73d3edea7fbb5ae6f8fc952212ffab2ee60a6352d2ef29ac86678ed6863ab 2021-01-13T08:29:46.941-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removing docker container: 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f 2021-01-13T08:29:46.952-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: cfc92338dbde8f205a2ba2dd4253ae6009dd7d4d24883e785a608f85ccaf275a 2021-01-13T08:29:46.955-08:00 INFO DockerTestBase [main] Removed docker container: f49a250aa75ed9bcb4ca7101fa0afdf3412de3473570b3753155742efffa2b34 2021-01-13T08:29:46.964-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 37f26fb6b295f5133c1efb3857e0a3b11423c45da8de7f4748b0f530170ce61a 2021-01-13T08:29:46.967-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-1] Removed docker container: 856287f98146c74f9963687bd7536b9b431fbec5dfacd075ef3fb05cbad3464f 2021-01-13T08:29:46.967-08:00 INFO DockerTestBase [main] Removing docker network: 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 2021-01-13T08:29:47.031-08:00 INFO DockerTestBase [main] Removed docker network: 36d6e33401826b7504f01df0fe03222fcc31aa39df2edfa7888e0a6d708dd557 2021-01-13T08:29:47.033-08:00 WARN TestMethodTracer [main] ### upgradeToCheckoutCBASOnlyMixedOnline SUCCEEDED 2021-01-13T08:29:47.034-08:00 WARN TestMethodTracer [main] ### upgradeVerifyClusterCompat START 2021-01-13T08:29:47.092-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382) 2021-01-13T08:29:47.163-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382, id = cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f } 2021-01-13T08:29:47.164-08:00 INFO UpgradeTestBase [main] Creating kv node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:29:47.165-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001kv to /opt/couchbase/var 2021-01-13T08:29:47.166-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0011_kv_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382, id = cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f }) 2021-01-13T08:29:48.124-08:00 INFO DockerTestBase [main] Container information for bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c: host: kv.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56756->192.168.176.2:8091, 172.17.0.1:56752->192.168.176.2:8095 2021-01-13T08:29:59.177-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv (192.168.176.2) 2021-01-13T08:29:59.177-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname kv.couchbase.host 2021-01-13T08:29:59.836-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:29:59.849-08:00 INFO UpgradeTestBase [main] Creating cbas1 node ([couchbase:enterprise-6.0.0])... 2021-01-13T08:29:59.849-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas1 to /opt/couchbase/var 2021-01-13T08:29:59.850-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0012_cbas1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382, id = cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f }) 2021-01-13T08:30:00.723-08:00 INFO DockerTestBase [main] Container information for 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b: host: cbas1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56771->192.168.176.3:8091, 172.17.0.1:56767->192.168.176.3:8095 2021-01-13T08:30:12.776-08:00 INFO DockerTestBase [main] Running 'node-init' on node cbas1 (192.168.176.3) 2021-01-13T08:30:12.776-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname cbas1.couchbase.host 2021-01-13T08:30:13.576-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:30:13.588-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node kv (192.168.176.2) with services: [DATA] 2021-01-13T08:30:13.588-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:30:14.025-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:30:14.049-08:00 INFO DockerTestBase [main] Running 'server-add' for node cbas1 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:30:14.049-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://cbas1.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:30:18.238-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:30:18.249-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:30:18.249-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:30:22.667-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:30:22.668-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:30:22.677-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:30:22.687-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:30:22.688-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:30:31.100-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56756] 2021-01-13T08:30:31.101-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56756 2021-01-13T08:30:31.142-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56771] 2021-01-13T08:30:34.797-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:30:35.454-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:30:35.455-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:30:36.664-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 249 } 2021-01-13T08:30:36.665-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 249 } 2021-01-13T08:30:37.812-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3764 } 2021-01-13T08:30:37.813-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3764 } 2021-01-13T08:30:38.975-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:30:38.975-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:30:38.975-08:00 INFO UpgradeTestBase [main] Upgrading cbas1.couchbase.host (online, rebalance) ... 2021-01-13T08:30:38.976-08:00 INFO UpgradeTestBase [main] Creating cbas1-new node using 'this build' docker image... 2021-01-13T08:30:38.976-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003cbas1new to /opt/couchbase/var 2021-01-13T08:30:38.977-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0013_cbas1new_thisbuild, network = { name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382, id = cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f }) 2021-01-13T08:30:40.074-08:00 INFO DockerTestBase [main] Container information for bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc: host: cbas1new.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56786->192.168.176.4:8091, 172.17.0.1:56782->192.168.176.4:8095 2021-01-13T08:30:49.529-08:00 INFO DockerTestBase [main] Running 'node-init' on node cbas1new (192.168.176.4) 2021-01-13T08:30:49.530-08:00 INFO DockerTestBase [main] Executing the command: docker exec bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname cbas1new.couchbase.host 2021-01-13T08:30:50.687-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:30:50.728-08:00 INFO DockerTestBase [main] Running 'server-add' for node cbas1new (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:30:50.728-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://cbas1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:30:54.988-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:30:54.998-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:30:54.999-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:30:54.999-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove cbas1.couchbase.host 2021-01-13T08:31:19.264-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:31:19.264-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:31:19.276-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:31:19.308-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:31:19.308-08:00 INFO DockerTestBase [main] Copying files from docker container 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0012_cbas1_couchbase_enterprise-6.0.0 2021-01-13T08:31:19.613-08:00 INFO DockerTestBase [main] Stopping docker container: 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b 2021-01-13T08:31:20.080-08:00 INFO DockerTestBase [main] Stopped docker container: 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b 2021-01-13T08:31:20.081-08:00 INFO DockerTestBase [main] Removing docker container: 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b 2021-01-13T08:31:20.094-08:00 INFO DockerTestBase [main] Removed docker container: 4533011c3bd4767244ca9371b19ed001e92630346456a28970178085054e244b 2021-01-13T08:31:20.095-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:31:26.594-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56786] 2021-01-13T08:31:26.595-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:31:27.676-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:31:27.677-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:31:27.850-08:00 INFO DockerTestBase [main] assuming 6.0 compatibility on missing 'clusterCompatibility' field 2021-01-13T08:31:27.850-08:00 INFO UpgradeTestBase [main] Upgrading kv.couchbase.host (online, rebalance) ... 2021-01-13T08:31:27.851-08:00 INFO UpgradeTestBase [main] Creating kv-new node using 'this build' docker image... 2021-01-13T08:31:27.852-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004kvnew to /opt/couchbase/var 2021-01-13T08:31:27.853-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0014_kvnew_thisbuild, network = { name = cbas-docker-test-0003-7c31489e-da3a-49f1-ab12-bf5725413382, id = cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f }) 2021-01-13T08:31:29.004-08:00 INFO DockerTestBase [main] Container information for 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35: host: kvnew.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56801->192.168.176.3:8091, 172.17.0.1:56797->192.168.176.3:8095 2021-01-13T08:31:40.049-08:00 INFO DockerTestBase [main] Running 'node-init' on node kvnew (192.168.176.3) 2021-01-13T08:31:40.049-08:00 INFO DockerTestBase [main] Executing the command: docker exec 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname kvnew.couchbase.host 2021-01-13T08:31:41.053-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:31:41.111-08:00 INFO DockerTestBase [main] Running 'server-add' for node kvnew (192.168.176.3) with services: [DATA] 2021-01-13T08:31:41.111-08:00 INFO DockerTestBase [main] Executing the command: docker exec bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://kvnew.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:31:45.427-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:31:45.472-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:31:45.472-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:31:45.472-08:00 INFO DockerTestBase [main] Executing the command: docker exec bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove kv.couchbase.host 2021-01-13T08:37:33.306-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:37:33.306-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:37:33.370-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:37:33.391-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:37:33.392-08:00 INFO DockerTestBase [main] Copying files from docker container bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0011_kv_couchbase_enterprise-6.0.0 2021-01-13T08:37:35.242-08:00 INFO DockerTestBase [main] Stopping docker container: bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c 2021-01-13T08:37:35.691-08:00 INFO DockerTestBase [main] Stopped docker container: bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c 2021-01-13T08:37:35.691-08:00 INFO DockerTestBase [main] Removing docker container: bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c 2021-01-13T08:37:35.730-08:00 INFO DockerTestBase [main] Removed docker container: bd2bc81e0af1257edb7b1d67eb797fa537f76f224cd31459a78cf6f472be766c 2021-01-13T08:37:35.750-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:37:35.763-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35ded65a[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@31e144be] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:36.779-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13887ece[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@1d4f8317] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:37.793-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@513369da[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@5ff49c54] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:38.807-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6920e27a[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@67e700f6] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:39.819-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4aa0278a[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@4467d176] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:40.833-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d29f1ca[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@43ee07c7] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:41.847-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a936d4e[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@145481b4] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:42.863-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e0647aa[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@5b04c2ae] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:43.877-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12acfa0e[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$474/0x000000010082d440@57ae6e9f] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@3c95ca4d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 46] 2021-01-13T08:37:44.881-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:37:45.885-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:46.888-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:47.891-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:48.895-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:37:49.898-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:50.907-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:51.912-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:52.916-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:53.921-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:54.925-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:37:56.166-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:37:57.564-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56786] 2021-01-13T08:37:57.565-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:37:58.152-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:37:58.153-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:37:58.153-08:00 INFO DockerTestBase [main] Copying files from docker container 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0014_kvnew_thisbuild 2021-01-13T08:37:58.154-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD/upgradeVerifyClusterCompat/0013_cbas1new_thisbuild 2021-01-13T08:38:00.695-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc 2021-01-13T08:38:01.092-08:00 INFO DockerTestBase [main] Stopping docker container: 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35 2021-01-13T08:38:01.331-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc 2021-01-13T08:38:01.479-08:00 INFO DockerTestBase [main] Stopped docker container: 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35 2021-01-13T08:38:01.481-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc 2021-01-13T08:38:01.482-08:00 INFO DockerTestBase [main] Removing docker container: 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35 2021-01-13T08:38:01.493-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: bc1b2b049a6f53cd8da6e63409f68fcedc7742d999e1762057877e8b8114f8fc 2021-01-13T08:38:01.495-08:00 INFO DockerTestBase [main] Removed docker container: 88961de08a35aa372bc0d094ab70484367725930b4a752121bda0af25bc25e35 2021-01-13T08:38:01.496-08:00 INFO DockerTestBase [main] Removing docker network: cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f 2021-01-13T08:38:01.557-08:00 INFO DockerTestBase [main] Removed docker network: cff5368313218e754576f7ecc0271443cafae1127ab268a25524a0482862716f 2021-01-13T08:38:01.559-08:00 WARN TestMethodTracer [main] ### upgradeVerifyClusterCompat SUCCEEDED [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 844.642 s - in com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600OnlineITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD 2021-01-13 08:38:03,544 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:38:03.622-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:38:03.639-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:38:03.639-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:38:03.936-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.5.0 2021-01-13T08:38:06.712-08:00 INFO DockerTestBase [main+] >> enterprise-6.5.0: Pulling from library/couchbase 2021-01-13T08:38:07.058-08:00 INFO DockerTestBase [main+] >> 7b378fa0f908: Already exists 2021-01-13T08:38:07.061-08:00 INFO DockerTestBase [main+] >> 4d77b1b29f2e: Already exists 2021-01-13T08:38:07.063-08:00 INFO DockerTestBase [main+] >> 7c793be88bae: Already exists 2021-01-13T08:38:07.066-08:00 INFO DockerTestBase [main+] >> ecc05c8a19c0: Already exists 2021-01-13T08:38:07.067-08:00 INFO DockerTestBase [main+] >> b6c136657def: Already exists 2021-01-13T08:38:07.071-08:00 INFO DockerTestBase [main+] >> 52161724de30: Pulling fs layer 2021-01-13T08:38:07.071-08:00 INFO DockerTestBase [main+] >> 6831fa052395: Pulling fs layer 2021-01-13T08:38:07.072-08:00 INFO DockerTestBase [main+] >> a366b22b3b30: Pulling fs layer 2021-01-13T08:38:07.072-08:00 INFO DockerTestBase [main+] >> 611ae7121f3c: Pulling fs layer 2021-01-13T08:38:07.072-08:00 INFO DockerTestBase [main+] >> b7a0db9ba8ca: Pulling fs layer 2021-01-13T08:38:07.072-08:00 INFO DockerTestBase [main+] >> 3aa7c8bb5cd8: Pulling fs layer 2021-01-13T08:38:07.073-08:00 INFO DockerTestBase [main+] >> 9aa5b3bea2c8: Pulling fs layer 2021-01-13T08:38:07.073-08:00 INFO DockerTestBase [main+] >> 1b5e7bd0b809: Pulling fs layer 2021-01-13T08:38:07.074-08:00 INFO DockerTestBase [main+] >> b7a0db9ba8ca: Waiting 2021-01-13T08:38:07.074-08:00 INFO DockerTestBase [main+] >> 3aa7c8bb5cd8: Waiting 2021-01-13T08:38:07.074-08:00 INFO DockerTestBase [main+] >> 9aa5b3bea2c8: Waiting 2021-01-13T08:38:07.074-08:00 INFO DockerTestBase [main+] >> 1b5e7bd0b809: Waiting 2021-01-13T08:38:07.075-08:00 INFO DockerTestBase [main+] >> 611ae7121f3c: Waiting 2021-01-13T08:38:07.387-08:00 INFO DockerTestBase [main+] >> a366b22b3b30: Verifying Checksum 2021-01-13T08:38:07.389-08:00 INFO DockerTestBase [main+] >> a366b22b3b30: Download complete 2021-01-13T08:38:07.441-08:00 INFO DockerTestBase [main+] >> 52161724de30: Verifying Checksum 2021-01-13T08:38:07.441-08:00 INFO DockerTestBase [main+] >> 52161724de30: Download complete 2021-01-13T08:38:07.617-08:00 INFO DockerTestBase [main+] >> 52161724de30: Pull complete 2021-01-13T08:38:07.733-08:00 INFO DockerTestBase [main+] >> 611ae7121f3c: Verifying Checksum 2021-01-13T08:38:07.733-08:00 INFO DockerTestBase [main+] >> 611ae7121f3c: Download complete 2021-01-13T08:38:07.806-08:00 INFO DockerTestBase [main+] >> b7a0db9ba8ca: Verifying Checksum 2021-01-13T08:38:07.806-08:00 INFO DockerTestBase [main+] >> b7a0db9ba8ca: Download complete 2021-01-13T08:38:08.081-08:00 INFO DockerTestBase [main+] >> 3aa7c8bb5cd8: Verifying Checksum 2021-01-13T08:38:08.082-08:00 INFO DockerTestBase [main+] >> 3aa7c8bb5cd8: Download complete 2021-01-13T08:38:08.171-08:00 INFO DockerTestBase [main+] >> 9aa5b3bea2c8: Verifying Checksum 2021-01-13T08:38:08.172-08:00 INFO DockerTestBase [main+] >> 9aa5b3bea2c8: Download complete 2021-01-13T08:38:08.765-08:00 INFO DockerTestBase [main+] >> 1b5e7bd0b809: Verifying Checksum 2021-01-13T08:38:08.765-08:00 INFO DockerTestBase [main+] >> 1b5e7bd0b809: Download complete 2021-01-13T08:38:20.520-08:00 INFO DockerTestBase [main+] >> 6831fa052395: Verifying Checksum 2021-01-13T08:38:20.521-08:00 INFO DockerTestBase [main+] >> 6831fa052395: Download complete 2021-01-13T08:38:34.263-08:00 INFO DockerTestBase [main+] >> 6831fa052395: Pull complete 2021-01-13T08:38:34.517-08:00 INFO DockerTestBase [main+] >> a366b22b3b30: Pull complete 2021-01-13T08:38:34.763-08:00 INFO DockerTestBase [main+] >> 611ae7121f3c: Pull complete 2021-01-13T08:38:35.008-08:00 INFO DockerTestBase [main+] >> b7a0db9ba8ca: Pull complete 2021-01-13T08:38:35.393-08:00 INFO DockerTestBase [main+] >> 3aa7c8bb5cd8: Pull complete 2021-01-13T08:38:35.764-08:00 INFO DockerTestBase [main+] >> 9aa5b3bea2c8: Pull complete 2021-01-13T08:38:35.864-08:00 INFO DockerTestBase [main+] >> 1b5e7bd0b809: Pull complete 2021-01-13T08:38:35.873-08:00 INFO DockerTestBase [main+] >> Digest: sha256:4694885d5630dbf28b986034c8b8c949125ef1811493b6567d0e5bfd96d8f7ff 2021-01-13T08:38:35.877-08:00 INFO DockerTestBase [main+] >> Status: Downloaded newer image for couchbase:enterprise-6.5.0 2021-01-13T08:38:35.880-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.5.0 2021-01-13T08:38:35.888-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat START 2021-01-13T08:38:37.196-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e) 2021-01-13T08:38:37.300-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e, id = 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa } 2021-01-13T08:38:37.302-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.5.0])... 2021-01-13T08:38:37.304-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:38:37.308-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.5.0, network = { name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e, id = 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa }) 2021-01-13T08:38:38.394-08:00 INFO DockerTestBase [main] Container information for daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56816->192.168.176.2:8091, 172.17.0.1:56812->192.168.176.2:8095 2021-01-13T08:38:45.504-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:38:45.506-08:00 INFO DockerTestBase [main] Executing the command: docker exec daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:38:46.292-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:38:46.316-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.5.0])... 2021-01-13T08:38:46.317-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:38:46.318-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.5.0, network = { name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e, id = 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa }) 2021-01-13T08:38:46.991-08:00 INFO DockerTestBase [main] Container information for 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56831->192.168.176.3:8091, 172.17.0.1:56827->192.168.176.3:8095 2021-01-13T08:38:54.217-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:38:54.218-08:00 INFO DockerTestBase [main] Executing the command: docker exec 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:38:54.954-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:38:54.993-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T08:38:54.994-08:00 INFO DockerTestBase [main] Executing the command: docker exec daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T08:38:55.376-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:38:55.425-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:39:04.913-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:39:04.914-08:00 INFO DockerTestBase [main] Executing the command: docker exec daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:39:07.679-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:39:07.701-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:39:07.702-08:00 INFO DockerTestBase [main] Executing the command: docker exec daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:39:16.112-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:39:16.113-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:39:16.158-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:39:16.169-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:39:16.170-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:39:16.311-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56816] 2021-01-13T08:39:16.316-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:56816 2021-01-13T08:39:17.371-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56831] 2021-01-13T08:39:20.674-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:39:20.676-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:39:21.417-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:39:21.422-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:39:22.423-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:39:22.914-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 532 } 2021-01-13T08:39:22.914-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 532 } 2021-01-13T08:39:23.915-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:39:24.391-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3259 } 2021-01-13T08:39:24.391-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3259 } 2021-01-13T08:39:25.595-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:39:25.595-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:39:25.596-08:00 INFO UpgradeTestBase [main] Upgrading n1.couchbase.host (online, rebalance) ... 2021-01-13T08:39:25.597-08:00 INFO UpgradeTestBase [main] Creating n1-new node using 'this build' docker image... 2021-01-13T08:39:25.598-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n1new to /opt/couchbase/var 2021-01-13T08:39:25.599-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:39:25.704-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:39:25.705-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:39:25.706-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:39:25.706-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:39:25.710-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild, network = { name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e, id = 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa }) 2021-01-13T08:39:26.601-08:00 INFO DockerTestBase [main] Container information for 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20: host: n1new.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56846->192.168.176.4:8091, 172.17.0.1:56842->192.168.176.4:8095 2021-01-13T08:39:35.643-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1new (192.168.176.4) 2021-01-13T08:39:35.644-08:00 INFO DockerTestBase [main] Executing the command: docker exec 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n1new.couchbase.host 2021-01-13T08:39:37.365-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:39:37.417-08:00 INFO DockerTestBase [main] Running 'server-add' for node n1new (192.168.176.4) with services: [DATA, ANALYTICS] 2021-01-13T08:39:37.417-08:00 INFO DockerTestBase [main] Executing the command: docker exec 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://n1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data,analytics 2021-01-13T08:39:41.628-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:39:41.669-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:39:41.669-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:39:41.671-08:00 INFO DockerTestBase [main] Executing the command: docker exec 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove n1.couchbase.host 2021-01-13T08:43:05.505-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:43:05.505-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:43:05.567-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:43:05.579-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:43:05.579-08:00 INFO DockerTestBase [main] Copying files from docker container daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.5.0 2021-01-13T08:43:06.873-08:00 INFO DockerTestBase [main] Stopping docker container: daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd 2021-01-13T08:43:07.378-08:00 INFO DockerTestBase [main] Stopped docker container: daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd 2021-01-13T08:43:07.379-08:00 INFO DockerTestBase [main] Removing docker container: daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd 2021-01-13T08:43:07.390-08:00 INFO DockerTestBase [main] Removed docker container: daae2ffede4ab8d82a82b667b56ea747788fe7dc4826f1f4beab1292c7694ddd 2021-01-13T08:43:07.394-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:43:07.394-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:43:15.158-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56831] 2021-01-13T08:43:15.158-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56846] 2021-01-13T08:43:15.159-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:43:15.159-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:43:15.159-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T08:43:15.160-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:43:16.077-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:43:16.078-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:43:16.082-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:43:16.082-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:43:16.083-08:00 INFO UpgradeTestBase [main] Upgrading n2.couchbase.host (online, rebalance) ... 2021-01-13T08:43:16.083-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T08:43:16.083-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n2new to /opt/couchbase/var 2021-01-13T08:43:16.084-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild, network = { name = cbas-docker-test-0001-3f92040a-27c9-46a2-9ae5-f2327a513d3e, id = 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa }) 2021-01-13T08:43:17.716-08:00 INFO DockerTestBase [main] Container information for ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a: host: n2new.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56861->192.168.176.2:8091, 172.17.0.1:56857->192.168.176.2:8095 2021-01-13T08:43:26.765-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.2) 2021-01-13T08:43:26.766-08:00 INFO DockerTestBase [main] Executing the command: docker exec ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T08:43:27.680-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:43:27.732-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.2) with services: [ANALYTICS] 2021-01-13T08:43:27.732-08:00 INFO DockerTestBase [main] Executing the command: docker exec 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:43:31.233-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:43:31.262-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:43:31.262-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:43:31.262-08:00 INFO DockerTestBase [main] Executing the command: docker exec 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host 2021-01-13T08:43:43.874-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:43:43.874-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:43:43.913-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:43:43.920-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:43:43.921-08:00 INFO DockerTestBase [main] Copying files from docker container 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.5.0 2021-01-13T08:43:44.310-08:00 INFO DockerTestBase [main] Stopping docker container: 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 2021-01-13T08:43:44.721-08:00 INFO DockerTestBase [main] Stopped docker container: 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 2021-01-13T08:43:44.726-08:00 INFO DockerTestBase [main] Removing docker container: 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 2021-01-13T08:43:44.743-08:00 INFO DockerTestBase [main] Removed docker container: 67c6a4a6a51191387023d82338ea743ce92d0b4c77ebc851aab6115b898ae846 2021-01-13T08:43:44.753-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:43:44.762-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:45.767-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:46.771-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:47.777-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:43:48.780-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:49.783-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:50.786-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:51.790-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:52.794-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:53.804-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:43:54.807-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:55.812-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:43:56.816-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:43:57.823-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:43:59.270-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:43:59.270-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:44:01.764-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56861] 2021-01-13T08:44:01.765-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:44:01.765-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:44:01.767-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56846] 2021-01-13T08:44:01.768-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:44:02.721-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:44:02.722-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:44:02.729-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:44:02.729-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:44:02.730-08:00 INFO UpgradeTestBase [main] Verifying metadata 2021-01-13T08:44:02.730-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56846] 2021-01-13T08:44:02.731-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:44:02.931-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild 2021-01-13T08:44:02.931-08:00 INFO DockerTestBase [main] Copying files from docker container ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild 2021-01-13T08:44:03.294-08:00 INFO DockerTestBase [main] Stopping docker container: ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a 2021-01-13T08:44:03.993-08:00 INFO DockerTestBase [main] Stopped docker container: ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a 2021-01-13T08:44:05.103-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 2021-01-13T08:44:05.478-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 2021-01-13T08:44:05.480-08:00 INFO DockerTestBase [main] Removing docker container: ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a 2021-01-13T08:44:05.480-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 2021-01-13T08:44:05.495-08:00 INFO DockerTestBase [main] Removed docker container: ba8310c5973ccac0e6544b196f31cac39e25264e1ba3c792c7690bb2cfdcc90a 2021-01-13T08:44:05.500-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 51010c4fbfbbb7b3d5736cf566fb3d3b6f33b7fc27f9829b3f3e9fcd751a1a20 2021-01-13T08:44:05.502-08:00 INFO DockerTestBase [main] Removing docker network: 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa 2021-01-13T08:44:05.563-08:00 INFO DockerTestBase [main] Removed docker network: 8318c5dac883b9f0ec3a351d4ccc179dcd22e367f3ec61a4ea8d52f93800c3fa 2021-01-13T08:44:05.570-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 363.162 s - in com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom650ITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD 2021-01-13 08:44:07,674 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:44:07.779-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:44:07.802-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:44:07.802-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:44:07.988-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics START 2021-01-13T08:44:09.193-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722) 2021-01-13T08:44:09.285-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 } 2021-01-13T08:44:09.305-08:00 INFO UpgradeTestBase [pool] Creating cbas2 node ([couchbase:enterprise-6.5.1])... 2021-01-13T08:44:09.304-08:00 INFO UpgradeTestBase [pool] Creating cbas1 node ([couchbase:enterprise-6.5.1])... 2021-01-13T08:44:09.312-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas1 to /opt/couchbase/var 2021-01-13T08:44:09.312-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001cbas2 to /opt/couchbase/var 2021-01-13T08:44:09.311-08:00 INFO UpgradeTestBase [pool] Creating kv1 node ([couchbase:enterprise-6.5.1])... 2021-01-13T08:44:09.315-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003kv1 to /opt/couchbase/var 2021-01-13T08:44:09.318-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.5.1 2021-01-13T08:44:10.399-08:00 INFO DockerTestBase [pool+] >> enterprise-6.5.1: Pulling from library/couchbase 2021-01-13T08:44:10.407-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:76c8f8324ea1f2eda9830eac2fff163648a07345aebf2574e778d74590a545e8 2021-01-13T08:44:10.408-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for couchbase:enterprise-6.5.1 2021-01-13T08:44:10.409-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.5.1 2021-01-13T08:44:10.412-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0003_cbas1_couchbase_enterprise-6.5.1, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:44:10.412-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0002_kv1_couchbase_enterprise-6.5.1, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:44:10.413-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0001_cbas2_couchbase_enterprise-6.5.1, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:44:11.873-08:00 INFO DockerTestBase [pool] Container information for bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296: host: kv1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56891->192.168.176.3:8091, 172.17.0.1:56885->192.168.176.3:8095 2021-01-13T08:44:11.877-08:00 INFO DockerTestBase [pool] Container information for 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1: host: cbas1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56888->192.168.176.2:8091, 172.17.0.1:56880->192.168.176.2:8095 2021-01-13T08:44:12.520-08:00 INFO DockerTestBase [pool] Container information for bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06: host: cbas2.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56906->192.168.176.4:8091, 172.17.0.1:56902->192.168.176.4:8095 2021-01-13T08:44:20.134-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas1 (192.168.176.2) 2021-01-13T08:44:20.136-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname cbas1.couchbase.host 2021-01-13T08:44:20.801-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas2 (192.168.176.4) 2021-01-13T08:44:20.803-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname cbas2.couchbase.host 2021-01-13T08:44:21.132-08:00 INFO DockerTestBase [pool] Running 'node-init' on node kv1 (192.168.176.3) 2021-01-13T08:44:21.132-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname kv1.couchbase.host 2021-01-13T08:44:21.179-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:44:21.828-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:44:22.409-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:44:22.439-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node kv1 (192.168.176.3) with services: [DATA] 2021-01-13T08:44:22.440-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:44:22.826-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T08:44:22.864-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas1 (192.168.176.2) with services: [ANALYTICS] 2021-01-13T08:44:22.864-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas2 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:44:22.865-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://cbas2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:44:22.866-08:00 INFO DockerTestBase [pool] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://cbas1.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:44:25.675-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:44:28.139-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:44:28.164-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:44:28.165-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase 2021-01-13T08:44:29.502-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:44:29.503-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:44:29.557-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:44:29.576-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:44:29.591-08:00 INFO DockerTestBase [pool] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:44:29.619-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56888] 2021-01-13T08:44:29.630-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:56888 2021-01-13T08:44:41.093-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56888] 2021-01-13T08:44:43.855-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:44:43.857-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:44:44.420-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:44:44.425-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:44:45.432-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:44:45.834-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1309 } 2021-01-13T08:44:45.835-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 1309 } 2021-01-13T08:44:46.836-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:44:47.054-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4099 } 2021-01-13T08:44:47.054-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 4099 } 2021-01-13T08:44:48.157-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:44:48.158-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:44:48.158-08:00 INFO UpgradeFailoverTestBase [main] Failing over (hard) cbas nodes ... 2021-01-13T08:44:48.160-08:00 INFO DockerTestBase [main] Running 'failover --force' on [cbas1 (192.168.176.2), cbas2 (192.168.176.4)] nodes 2021-01-13T08:44:48.161-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli failover -c 192.168.176.3:8091 -u couchbase -p couchbase --server-failover cbas1.couchbase.host,cbas2.couchbase.host --force 2021-01-13T08:44:48.531-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server failed over 2021-01-13T08:44:53.577-08:00 INFO UpgradeTestBase [main] Recreating 'cbas2' node (image = null, forceNewIp = false)... 2021-01-13T08:44:53.578-08:00 INFO DockerTestBase [main] Copying files from docker container bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0001_cbas2_couchbase_enterprise-6.5.1 2021-01-13T08:44:53.578-08:00 INFO UpgradeTestBase [ForkJoinPool.commonPool-worker-3] Recreating 'cbas1' node (image = null, forceNewIp = false)... 2021-01-13T08:44:53.582-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0003_cbas1_couchbase_enterprise-6.5.1 2021-01-13T08:44:53.860-08:00 INFO DockerTestBase [main] Stopping docker container: bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06 2021-01-13T08:44:53.860-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1 2021-01-13T08:44:54.376-08:00 INFO DockerTestBase [main] Stopped docker container: bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06 2021-01-13T08:44:54.377-08:00 INFO DockerTestBase [main] Removing docker container: bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06 2021-01-13T08:44:54.392-08:00 INFO DockerTestBase [main] Removed docker container: bafe32909f689b880ca1c13d31b362b73893f2f4d7a7ac901a4b7cd53806fa06 2021-01-13T08:44:54.394-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:44:54.442-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1 2021-01-13T08:44:54.444-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1 2021-01-13T08:44:54.455-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 0c65787131ba883246873f56b5b06d9140d94f329e415f441b6592d1e2e829c1 2021-01-13T08:44:54.481-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:44:54.484-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:44:54.484-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:44:54.485-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:44:54.490-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:44:54.490-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:44:55.493-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Container information for 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06: host: cbas1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56934->192.168.176.2:8091, 172.17.0.1:56926->192.168.176.2:8095 2021-01-13T08:44:55.591-08:00 INFO DockerTestBase [main] Container information for 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3: host: cbas2.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56936->192.168.176.4:8091, 172.17.0.1:56929->192.168.176.4:8095 2021-01-13T08:45:04.648-08:00 INFO DockerTestBase [main] Running full 'recovery' on nodes [cbas1 (192.168.176.2), cbas2 (192.168.176.4)] 2021-01-13T08:45:04.649-08:00 INFO DockerTestBase [main] Executing the command: docker exec bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 /opt/couchbase/bin/couchbase-cli recovery -c 192.168.176.3:8091 -u couchbase -p couchbase --server-recovery cbas1.couchbase.host,cbas2.couchbase.host --recovery-type full 2021-01-13T08:45:04.989-08:00 INFO DockerTestBase [main+] >> SUCCESS: Servers recovered 2021-01-13T08:45:05.042-08:00 INFO UpgradeTestBase [main] Upgrading kv1.couchbase.host (online, rebalance) ... 2021-01-13T08:45:05.043-08:00 INFO UpgradeTestBase [main] Creating kv1-new node using 'this build' docker image... 2021-01-13T08:45:05.043-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004kv1new to /opt/couchbase/var 2021-01-13T08:45:05.046-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild, network = { name = cbas-docker-test-0001-09c812e3-3665-4ed9-b89f-f3e5b373c722, id = 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 }) 2021-01-13T08:45:05.836-08:00 INFO DockerTestBase [main] Container information for cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2: host: kv1new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:56951->192.168.176.5:8091, 172.17.0.1:56947->192.168.176.5:8095 2021-01-13T08:45:14.873-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv1new (192.168.176.5) 2021-01-13T08:45:14.873-08:00 INFO DockerTestBase [main] Executing the command: docker exec cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname kv1new.couchbase.host 2021-01-13T08:45:16.021-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:45:16.067-08:00 INFO DockerTestBase [main] Running 'server-add' for node kv1new (192.168.176.5) with services: [DATA] 2021-01-13T08:45:16.067-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://kv1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:45:19.385-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:45:19.414-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:45:19.414-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:45:19.415-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase --server-remove kv1.couchbase.host 2021-01-13T08:47:02.173-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:47:02.174-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:47:02.206-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:47:02.227-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:47:02.228-08:00 INFO DockerTestBase [main] Copying files from docker container bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0002_kv1_couchbase_enterprise-6.5.1 2021-01-13T08:47:02.962-08:00 INFO DockerTestBase [main] Stopping docker container: bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 2021-01-13T08:47:03.455-08:00 INFO DockerTestBase [main] Stopped docker container: bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 2021-01-13T08:47:03.456-08:00 INFO DockerTestBase [main] Removing docker container: bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 2021-01-13T08:47:03.467-08:00 INFO DockerTestBase [main] Removed docker container: bd7f33e0497bf6d3c07da93a775ce7568191bb48d4a7cdb37a746f92d3ba2296 2021-01-13T08:47:03.474-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:47:03.475-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:47:03.479-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:03.479-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:04.482-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:04.482-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:05.487-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:05.487-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:06.492-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:06.492-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:07.497-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:07.497-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:08.500-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:08.502-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:09.505-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:09.506-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:10.509-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:10.511-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:11.513-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:11.514-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:12.517-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:12.517-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:13.521-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:13.522-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:14.526-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:14.526-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:15.531-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:15.531-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:16.535-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:16.536-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:17.539-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:17.541-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:18.543-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:18.544-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:19.547-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:47:20.551-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:47:21.959-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:47:21.959-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:47:23.384-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56936] 2021-01-13T08:47:23.384-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56934] 2021-01-13T08:47:23.385-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:47:23.385-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:47:23.385-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:47:23.386-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T08:47:24.172-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:47:24.172-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:47:24.181-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:47:24.182-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:47:25.173-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:47:25.629-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:47:25.630-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:47:25.655-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:47:25.655-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:47:26.630-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:47:26.656-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T08:47:27.169-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 481 } 2021-01-13T08:47:27.170-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 481 } 2021-01-13T08:47:27.175-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 481 } 2021-01-13T08:47:27.175-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 3. ResultSet found : { "$1": 481 } 2021-01-13T08:47:28.171-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:47:28.446-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2936 } 2021-01-13T08:47:28.446-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 2936 } 2021-01-13T08:47:28.531-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2936 } 2021-01-13T08:47:28.531-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 4. ResultSet found : { "$1": 2936 } 2021-01-13T08:47:29.447-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:47:29.532-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T08:47:29.586-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:47:29.587-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:47:29.710-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:47:29.710-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:47:29.712-08:00 INFO DockerTestBase [main] Copying files from docker container 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild 2021-01-13T08:47:29.713-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild 2021-01-13T08:47:29.713-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild 2021-01-13T08:47:30.220-08:00 INFO DockerTestBase [main] Stopping docker container: 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3 2021-01-13T08:47:30.690-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2 2021-01-13T08:47:31.366-08:00 INFO DockerTestBase [main] Stopped docker container: 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3 2021-01-13T08:47:31.452-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 2021-01-13T08:47:31.766-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2 2021-01-13T08:47:31.883-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 2021-01-13T08:47:31.885-08:00 INFO DockerTestBase [main] Removing docker container: 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3 2021-01-13T08:47:31.885-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 2021-01-13T08:47:31.886-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2 2021-01-13T08:47:31.895-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 4e2b1c4ea7e7a975150c4e971617c4ba4f24e22602c262c536cf733d06397f06 2021-01-13T08:47:31.895-08:00 INFO DockerTestBase [main] Removed docker container: 42cafd09a7667207be12a8e8351e2823d19efa54302a8dc9eb97f3f1da626df3 2021-01-13T08:47:31.904-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: cbdaefab5cb4837672bcf6592e179eab3a1a5775ea7437574b70f488291446d2 2021-01-13T08:47:31.905-08:00 INFO DockerTestBase [main] Removing docker network: 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 2021-01-13T08:47:31.951-08:00 INFO DockerTestBase [main] Removed docker network: 0b8ec545da5d5bdbab7f82dc7e023d3b027abb69178e6029d472fa2ba7302249 2021-01-13T08:47:31.957-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 205.485 s - in com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom651FailoverITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD 2021-01-13 08:47:34,050 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:47:34.132-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:47:34.148-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:47:34.149-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:47:34.271-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics START 2021-01-13T08:47:35.365-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2) 2021-01-13T08:47:35.439-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab } 2021-01-13T08:47:35.458-08:00 INFO UpgradeTestBase [pool] Creating cbas1 node ([couchbase:enterprise-6.6.0])... 2021-01-13T08:47:35.458-08:00 INFO UpgradeTestBase [pool] Creating cbas2 node ([couchbase:enterprise-6.6.0])... 2021-01-13T08:47:35.458-08:00 INFO UpgradeTestBase [pool] Creating kv1 node ([couchbase:enterprise-6.6.0])... 2021-01-13T08:47:35.476-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001cbas1 to /opt/couchbase/var 2021-01-13T08:47:35.476-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003kv1 to /opt/couchbase/var 2021-01-13T08:47:35.476-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas2 to /opt/couchbase/var 2021-01-13T08:47:35.480-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.6.0 2021-01-13T08:47:36.626-08:00 INFO DockerTestBase [pool+] >> enterprise-6.6.0: Pulling from library/couchbase 2021-01-13T08:47:36.634-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:7c2cb7b39d2b7e88d4885385bd996af5bbdf2cd39ee3d5725151aede8cc98f71 2021-01-13T08:47:36.634-08:00 INFO DockerTestBase [pool+] >> Status: Image is up to date for couchbase:enterprise-6.6.0 2021-01-13T08:47:36.638-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.6.0 2021-01-13T08:47:36.641-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0002_cbas2_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:47:36.641-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0003_cbas1_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:47:36.641-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0001_kv1_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:47:37.890-08:00 INFO DockerTestBase [pool] Container information for 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227: host: cbas2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:56975->192.168.176.3:8095, 172.17.0.1:56981->192.168.176.3:8091 2021-01-13T08:47:37.900-08:00 INFO DockerTestBase [pool] Container information for b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0: host: kv1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:56970->192.168.176.2:8095, 172.17.0.1:56978->192.168.176.2:8091 2021-01-13T08:47:38.432-08:00 INFO DockerTestBase [pool] Container information for 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737: host: cbas1.couchbase.host, ip: 192.168.176.4, 172.17.0.1:56992->192.168.176.4:8095, 172.17.0.1:56996->192.168.176.4:8091 2021-01-13T08:47:46.391-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas2 (192.168.176.3) 2021-01-13T08:47:46.393-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname cbas2.couchbase.host 2021-01-13T08:47:46.629-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas1 (192.168.176.4) 2021-01-13T08:47:46.630-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname cbas1.couchbase.host 2021-01-13T08:47:47.078-08:00 INFO DockerTestBase [pool] Running 'node-init' on node kv1 (192.168.176.2) 2021-01-13T08:47:47.079-08:00 INFO DockerTestBase [pool] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname kv1.couchbase.host 2021-01-13T08:47:47.461-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:47:47.479-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:47:47.947-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-13T08:47:47.974-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node kv1 (192.168.176.2) with services: [DATA] 2021-01-13T08:47:47.974-08:00 INFO DockerTestBase [pool] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:47:48.358-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-13T08:47:48.404-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas1 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:47:48.405-08:00 INFO DockerTestBase [pool] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://cbas1.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:47:48.406-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:47:48.406-08:00 INFO DockerTestBase [pool] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://cbas2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:47:51.142-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:47:53.265-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-13T08:47:53.297-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:47:53.299-08:00 INFO DockerTestBase [main] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:47:54.641-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:47:54.642-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:47:54.699-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:47:54.713-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:47:54.732-08:00 INFO DockerTestBase [pool] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:47:54.833-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56996] 2021-01-13T08:47:54.848-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:56996 2021-01-13T08:48:05.535-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:56996] 2021-01-13T08:48:09.076-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:48:09.079-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:48:09.889-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:48:09.898-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:48:10.899-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:48:11.372-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2864 } 2021-01-13T08:48:11.372-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2864 } 2021-01-13T08:48:12.373-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:48:12.634-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 4204 } 2021-01-13T08:48:12.634-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 4204 } 2021-01-13T08:48:13.772-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:48:13.773-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:48:13.773-08:00 INFO UpgradeFailoverTestBase [main] Failing over (hard) cbas nodes ... 2021-01-13T08:48:13.775-08:00 INFO DockerTestBase [main] Running 'failover --hard' on [cbas1 (192.168.176.4), cbas2 (192.168.176.3)] nodes 2021-01-13T08:48:13.776-08:00 INFO DockerTestBase [main] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli failover -c 192.168.176.2:8091 -u couchbase -p couchbase --server-failover cbas1.couchbase.host,cbas2.couchbase.host --hard 2021-01-13T08:48:14.175-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server failed over 2021-01-13T08:48:19.243-08:00 INFO UpgradeTestBase [main] Recreating 'cbas2' node (image = null, forceNewIp = false)... 2021-01-13T08:48:19.244-08:00 INFO DockerTestBase [main] Copying files from docker container 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0002_cbas2_couchbase_enterprise-6.6.0 2021-01-13T08:48:19.243-08:00 INFO UpgradeTestBase [ForkJoinPool.commonPool-worker-3] Recreating 'cbas1' node (image = null, forceNewIp = false)... 2021-01-13T08:48:19.244-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0003_cbas1_couchbase_enterprise-6.6.0 2021-01-13T08:48:19.534-08:00 INFO DockerTestBase [main] Stopping docker container: 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227 2021-01-13T08:48:19.555-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737 2021-01-13T08:48:20.056-08:00 INFO DockerTestBase [main] Stopped docker container: 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227 2021-01-13T08:48:20.057-08:00 INFO DockerTestBase [main] Removing docker container: 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227 2021-01-13T08:48:20.069-08:00 INFO DockerTestBase [main] Removed docker container: 763792624b6342488fbc6c89d4a4d509b2c20d6b4e1f87068f69c185c03b0227 2021-01-13T08:48:20.071-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:48:20.118-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737 2021-01-13T08:48:20.118-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737 2021-01-13T08:48:20.141-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 0433d4a0e635c2dd45f410b2b30d0bb34995f7ecd2943fbff588179fdc208737 2021-01-13T08:48:20.209-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:48:20.212-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:48:20.213-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:48:20.214-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:48:20.217-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:48:20.217-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:48:21.233-08:00 INFO DockerTestBase [main] Container information for 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632: host: cbas2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:57016->192.168.176.3:8095, 172.17.0.1:57024->192.168.176.3:8091 2021-01-13T08:48:21.303-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Container information for 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6: host: cbas1.couchbase.host, ip: 192.168.176.4, 172.17.0.1:57019->192.168.176.4:8095, 172.17.0.1:57026->192.168.176.4:8091 2021-01-13T08:48:29.350-08:00 INFO DockerTestBase [main] Running full 'recovery' on nodes [cbas1 (192.168.176.4), cbas2 (192.168.176.3)] 2021-01-13T08:48:29.352-08:00 INFO DockerTestBase [main] Executing the command: docker exec b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 /opt/couchbase/bin/couchbase-cli recovery -c 192.168.176.2:8091 -u couchbase -p couchbase --server-recovery cbas1.couchbase.host,cbas2.couchbase.host --recovery-type full 2021-01-13T08:48:29.775-08:00 INFO DockerTestBase [main+] >> SUCCESS: Servers recovered 2021-01-13T08:48:29.832-08:00 INFO UpgradeTestBase [main] Upgrading kv1.couchbase.host (online, rebalance) ... 2021-01-13T08:48:29.833-08:00 INFO UpgradeTestBase [main] Creating kv1-new node using 'this build' docker image... 2021-01-13T08:48:29.833-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004kv1new to /opt/couchbase/var 2021-01-13T08:48:29.834-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild, network = { name = cbas-docker-test-0001-2ec03344-a89f-4111-b532-cca546e73ae2, id = 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab }) 2021-01-13T08:48:30.671-08:00 INFO DockerTestBase [main] Container information for f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701: host: kv1new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:57037->192.168.176.5:8095, 172.17.0.1:57041->192.168.176.5:8091 2021-01-13T08:48:39.706-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv1new (192.168.176.5) 2021-01-13T08:48:39.707-08:00 INFO DockerTestBase [main] Executing the command: docker exec f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname kv1new.couchbase.host 2021-01-13T08:48:40.408-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:48:40.443-08:00 INFO DockerTestBase [main] Running 'server-add' for node kv1new (192.168.176.5) with services: [DATA] 2021-01-13T08:48:40.444-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://kv1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:48:44.056-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:48:44.087-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:48:44.087-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:48:44.088-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove kv1.couchbase.host 2021-01-13T08:50:28.665-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:50:28.665-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:50:28.746-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:50:28.769-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:50:28.770-08:00 INFO DockerTestBase [main] Copying files from docker container b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0001_kv1_couchbase_enterprise-6.6.0 2021-01-13T08:50:29.373-08:00 INFO DockerTestBase [main] Stopping docker container: b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 2021-01-13T08:50:29.791-08:00 INFO DockerTestBase [main] Stopped docker container: b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 2021-01-13T08:50:29.791-08:00 INFO DockerTestBase [main] Removing docker container: b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 2021-01-13T08:50:29.802-08:00 INFO DockerTestBase [main] Removed docker container: b0d99425057a77485dab6750dfaf6436b4ba6d79ee3d15c4d474a3d965d019b0 2021-01-13T08:50:29.813-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:50:29.813-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:50:29.817-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:29.825-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:30.820-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:30.828-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:31.824-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:31.832-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:32.827-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:32.835-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:33.832-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:33.840-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:34.836-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:34.845-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:35.841-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:35.850-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:36.846-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:36.853-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:37.850-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:37.857-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:38.856-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:38.863-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:39.861-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:39.870-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:40.865-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:40.874-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:41.869-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:41.879-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:42.873-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:42.884-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:43.877-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:43.888-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:44.881-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:44.892-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:45.897-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:46.901-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:47.905-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T08:50:48.909-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T08:50:50.079-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:50:50.079-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:50:51.362-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57024] 2021-01-13T08:50:51.362-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57026] 2021-01-13T08:50:51.363-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:50:51.363-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:50:51.363-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:50:51.364-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T08:50:52.233-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:50:52.233-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:50:52.243-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:50:52.243-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:50:53.234-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:50:53.486-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 0 } 2021-01-13T08:50:53.487-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:50:53.528-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:50:53.529-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 0 } 2021-01-13T08:50:54.488-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T08:50:54.529-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:50:54.850-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 627 } 2021-01-13T08:50:54.850-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 3. ResultSet found : { "$1": 627 } 2021-01-13T08:50:54.900-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 723 } 2021-01-13T08:50:54.900-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 723 } 2021-01-13T08:50:55.851-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T08:50:56.122-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 2955 } 2021-01-13T08:50:56.122-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Failed attempt number: 4. ResultSet found : { "$1": 2955 } 2021-01-13T08:50:56.134-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2955 } 2021-01-13T08:50:56.134-08:00 INFO DockerTestBase [main] Failed attempt number: 4. ResultSet found : { "$1": 2955 } 2021-01-13T08:50:57.123-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16LE 2021-01-13T08:50:57.135-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:50:57.289-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:50:57.290-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:50:57.298-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:50:57.298-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:50:57.300-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild 2021-01-13T08:50:57.300-08:00 INFO DockerTestBase [main] Copying files from docker container 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild 2021-01-13T08:50:57.304-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild 2021-01-13T08:50:57.774-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632 2021-01-13T08:50:58.475-08:00 INFO DockerTestBase [main] Stopping docker container: 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 2021-01-13T08:50:58.627-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701 2021-01-13T08:50:58.823-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632 2021-01-13T08:50:58.991-08:00 INFO DockerTestBase [main] Stopped docker container: 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 2021-01-13T08:50:59.174-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701 2021-01-13T08:50:59.176-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632 2021-01-13T08:50:59.176-08:00 INFO DockerTestBase [main] Removing docker container: 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 2021-01-13T08:50:59.176-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701 2021-01-13T08:50:59.185-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 026b0bc35696d268866f55e1da295281d7a9614062f718c1f2d7cc3a4189b632 2021-01-13T08:50:59.185-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: f0227993062b656f1e4a9fc5805cc3e3887ab3e49e5504fffc8a5660b2216701 2021-01-13T08:50:59.190-08:00 INFO DockerTestBase [main] Removed docker container: 9349e030a9d9180425b4bd10374304cc24f912732f4c1869669a4dbea57d99e6 2021-01-13T08:50:59.191-08:00 INFO DockerTestBase [main] Removing docker network: 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab 2021-01-13T08:50:59.260-08:00 INFO DockerTestBase [main] Removed docker network: 7ac75b510ee6da6f31682d5099408dbf2847451faa654736f61bf623e1c6d4ab 2021-01-13T08:50:59.266-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 206.372 s - in com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660FailoverITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD 2021-01-13 08:51:01,221 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:51:01.297-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:51:01.312-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:51:01.313-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:51:01.444-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-6.6.0 2021-01-13T08:51:02.697-08:00 INFO DockerTestBase [main+] >> enterprise-6.6.0: Pulling from library/couchbase 2021-01-13T08:51:02.710-08:00 INFO DockerTestBase [main+] >> Digest: sha256:7c2cb7b39d2b7e88d4885385bd996af5bbdf2cd39ee3d5725151aede8cc98f71 2021-01-13T08:51:02.710-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-6.6.0 2021-01-13T08:51:02.713-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-6.6.0 2021-01-13T08:51:02.720-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat START 2021-01-13T08:51:03.831-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68) 2021-01-13T08:51:03.921-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68, id = 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d } 2021-01-13T08:51:03.922-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-6.6.0])... 2021-01-13T08:51:03.924-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:51:03.927-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68, id = 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d }) 2021-01-13T08:51:04.931-08:00 INFO DockerTestBase [main] Container information for b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:57057->192.168.176.2:8091, 172.17.0.1:57053->192.168.176.2:8095 2021-01-13T08:51:12.044-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:51:12.045-08:00 INFO DockerTestBase [main] Executing the command: docker exec b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:51:12.832-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:51:12.872-08:00 INFO UpgradeTestBase [main] Creating n2 node ([couchbase:enterprise-6.6.0])... 2021-01-13T08:51:12.873-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:51:12.873-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.6.0, network = { name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68, id = 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d }) 2021-01-13T08:51:13.545-08:00 INFO DockerTestBase [main] Container information for e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:57073->192.168.176.3:8091, 172.17.0.1:57069->192.168.176.3:8095 2021-01-13T08:51:20.582-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:51:20.583-08:00 INFO DockerTestBase [main] Executing the command: docker exec e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:51:21.339-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:51:21.366-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA, ANALYTICS] 2021-01-13T08:51:21.367-08:00 INFO DockerTestBase [main] Executing the command: docker exec b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data,analytics 2021-01-13T08:51:21.781-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:51:21.835-08:00 INFO DockerTestBase [main] Waiting for NCs == 1 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:51:30.299-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:51:30.300-08:00 INFO DockerTestBase [main] Executing the command: docker exec b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:51:33.067-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:51:33.088-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:51:33.089-08:00 INFO DockerTestBase [main] Executing the command: docker exec b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:51:41.470-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:51:41.471-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:51:41.507-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:51:41.523-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:51:41.524-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:51:41.633-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57057] 2021-01-13T08:51:41.638-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:57057 2021-01-13T08:51:42.679-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57073] 2021-01-13T08:51:46.009-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:51:46.012-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:51:46.822-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:51:46.827-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:51:47.829-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:51:48.468-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 1796 } 2021-01-13T08:51:48.469-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 1796 } 2021-01-13T08:51:49.469-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:51:49.608-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:51:49.609-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:51:49.609-08:00 INFO UpgradeTestBase [main] Upgrading n1.couchbase.host (online, rebalance) ... 2021-01-13T08:51:49.609-08:00 INFO UpgradeTestBase [main] Creating n1-new node using 'this build' docker image... 2021-01-13T08:51:49.610-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n1new to /opt/couchbase/var 2021-01-13T08:51:49.610-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:51:49.690-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:51:49.693-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:51:49.694-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:51:49.695-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:51:49.698-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild, network = { name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68, id = 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d }) 2021-01-13T08:51:50.558-08:00 INFO DockerTestBase [main] Container information for 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059: host: n1new.couchbase.host, ip: 192.168.176.4, 172.17.0.1:57088->192.168.176.4:8091, 172.17.0.1:57084->192.168.176.4:8095 2021-01-13T08:51:58.600-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1new (192.168.176.4) 2021-01-13T08:51:58.601-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n1new.couchbase.host 2021-01-13T08:51:59.301-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:51:59.333-08:00 INFO DockerTestBase [main] Running 'server-add' for node n1new (192.168.176.4) with services: [DATA, ANALYTICS] 2021-01-13T08:51:59.333-08:00 INFO DockerTestBase [main] Executing the command: docker exec e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://n1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data,analytics 2021-01-13T08:52:02.978-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:52:03.023-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:52:03.024-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:52:03.025-08:00 INFO DockerTestBase [main] Executing the command: docker exec e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove n1.couchbase.host 2021-01-13T08:55:16.081-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:55:16.082-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:55:16.158-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:55:16.178-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:55:16.180-08:00 INFO DockerTestBase [main] Copying files from docker container b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0001_n1_couchbase_enterprise-6.6.0 2021-01-13T08:55:17.598-08:00 INFO DockerTestBase [main] Stopping docker container: b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba 2021-01-13T08:55:18.037-08:00 INFO DockerTestBase [main] Stopped docker container: b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba 2021-01-13T08:55:18.038-08:00 INFO DockerTestBase [main] Removing docker container: b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba 2021-01-13T08:55:18.072-08:00 INFO DockerTestBase [main] Removed docker container: b5b03c7cf5ca5758caff7aac609001a89fad77d0bfeeb38419b01b7a5ac4afba 2021-01-13T08:55:18.075-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:55:18.080-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:55:27.563-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57088] 2021-01-13T08:55:27.564-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:55:27.564-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57073] 2021-01-13T08:55:27.565-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:55:27.565-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:55:28.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:55:28.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:55:28.546-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:55:28.547-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:55:28.547-08:00 INFO UpgradeTestBase [main] Upgrading n2.couchbase.host (online, rebalance) ... 2021-01-13T08:55:28.547-08:00 INFO UpgradeTestBase [main] Creating n2-new node using 'this build' docker image... 2021-01-13T08:55:28.548-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n2new to /opt/couchbase/var 2021-01-13T08:55:28.548-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild, network = { name = cbas-docker-test-0001-d83e9104-3c6f-499b-b428-346419d31b68, id = 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d }) 2021-01-13T08:55:29.477-08:00 INFO DockerTestBase [main] Container information for 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1: host: n2new.couchbase.host, ip: 192.168.176.2, 172.17.0.1:57103->192.168.176.2:8091, 172.17.0.1:57099->192.168.176.2:8095 2021-01-13T08:55:37.752-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2new (192.168.176.2) 2021-01-13T08:55:37.753-08:00 INFO DockerTestBase [main] Executing the command: docker exec 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n2new.couchbase.host 2021-01-13T08:55:38.744-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:55:38.781-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2new (192.168.176.2) with services: [ANALYTICS] 2021-01-13T08:55:38.781-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://n2new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:55:42.577-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:55:42.613-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:55:42.613-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:55:42.613-08:00 INFO DockerTestBase [main] Executing the command: docker exec 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase --server-remove n2.couchbase.host 2021-01-13T08:55:56.149-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:55:56.150-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:55:56.184-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:55:56.197-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:55:56.197-08:00 INFO DockerTestBase [main] Copying files from docker container e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0002_n2_couchbase_enterprise-6.6.0 2021-01-13T08:55:56.689-08:00 INFO DockerTestBase [main] Stopping docker container: e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b 2021-01-13T08:55:57.129-08:00 INFO DockerTestBase [main] Stopped docker container: e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b 2021-01-13T08:55:57.129-08:00 INFO DockerTestBase [main] Removing docker container: e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b 2021-01-13T08:55:57.148-08:00 INFO DockerTestBase [main] Removed docker container: e29f553b3e24fc7309210a32dd339ad6c82238bf8d2304ff60699d3e895ebc0b 2021-01-13T08:55:57.148-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:56:14.108-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T08:56:14.448-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:56:14.448-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:56:14.575-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57103] 2021-01-13T08:56:14.575-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:56:14.576-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:56:14.577-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57088] 2021-01-13T08:56:14.578-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T08:56:14.578-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-32 2021-01-13T08:56:15.500-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:56:15.500-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:56:15.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T08:56:15.541-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T08:56:15.542-08:00 INFO UpgradeTestBase [main] Verifying metadata 2021-01-13T08:56:15.542-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57088] 2021-01-13T08:56:15.857-08:00 INFO DockerTestBase [main] Copying files from docker container 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0004_n2new_thisbuild 2021-01-13T08:56:15.857-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD/upgradeOnlineVerifyClusterCompat/0003_n1new_thisbuild 2021-01-13T08:56:16.392-08:00 INFO DockerTestBase [main] Stopping docker container: 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1 2021-01-13T08:56:16.903-08:00 INFO DockerTestBase [main] Stopped docker container: 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1 2021-01-13T08:56:18.233-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 2021-01-13T08:56:18.552-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 2021-01-13T08:56:18.553-08:00 INFO DockerTestBase [main] Removing docker container: 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1 2021-01-13T08:56:18.554-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 2021-01-13T08:56:18.566-08:00 INFO DockerTestBase [main] Removed docker container: 54e0b5a42a70f7c6b967d5f15e0e01d00b737352bc2485255bd7eea3aefc34b1 2021-01-13T08:56:18.575-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 9165dabc94e89105b4bbe5d4e1c190cd68be6ee520f3df89d828e61ae8b85059 2021-01-13T08:56:18.576-08:00 INFO DockerTestBase [main] Removing docker network: 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d 2021-01-13T08:56:18.642-08:00 INFO DockerTestBase [main] Removed docker network: 6b05f2702f148938bf18239c6c10b2239bbc77903d9082fb602d970c6d9e777d 2021-01-13T08:56:18.649-08:00 WARN TestMethodTracer [main] ### upgradeOnlineVerifyClusterCompat SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 318.556 s - in com.couchbase.analytics.test.docker.upgrade.madhatter.UpgradeFrom660ITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.misc.SecondaryCompositeIndexITD [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.014 s - in com.couchbase.analytics.test.docker.upgrade.misc.SecondaryCompositeIndexITD [INFO] Running com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD 2021-01-13 08:56:21,488 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-13T08:56:21.562-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-13T08:56:21.578-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-13T08:56:21.578-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 dockerHostAddr=172.17.0.1 dockerContainerId=3667c5051f1ef292c9e2a70cf6cd0693b37d1be07a99f4dd59fa52bd24500f70 2021-01-13T08:56:21.738-08:00 INFO DockerTestBase [main] Executing the command: docker pull couchbase:enterprise-5.5.2 2021-01-13T08:56:22.834-08:00 INFO DockerTestBase [main+] >> enterprise-5.5.2: Pulling from library/couchbase 2021-01-13T08:56:22.841-08:00 INFO DockerTestBase [main+] >> Digest: sha256:dcdf07a219ba5fe10bf6270082eb57b60320bb520a1f019b4793b9d0ec9fa2ba 2021-01-13T08:56:22.842-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for couchbase:enterprise-5.5.2 2021-01-13T08:56:22.842-08:00 INFO DockerTestBase [main+] >> docker.io/library/couchbase:enterprise-5.5.2 2021-01-13T08:56:22.852-08:00 WARN TestMethodTracer [main] ### upgrade55ToCheckoutOnline START 2021-01-13T08:56:23.960-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410) 2021-01-13T08:56:24.045-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410, id = 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb } 2021-01-13T08:56:24.046-08:00 INFO UpgradeTestBase [main] Creating n1 node ([couchbase:enterprise-5.5.2])... 2021-01-13T08:56:24.048-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001n1 to /opt/couchbase/var 2021-01-13T08:56:24.050-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0001_n1_couchbase_enterprise-5.5.2, network = { name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410, id = 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb }) 2021-01-13T08:56:24.940-08:00 INFO DockerTestBase [main] Container information for 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a: host: n1.couchbase.host, ip: 192.168.176.2, 172.17.0.1:57118->192.168.176.2:8091, 172.17.0.1:57114->192.168.176.2:8095 2021-01-13T08:56:35.334-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1 (192.168.176.2) 2021-01-13T08:56:35.337-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname n1.couchbase.host 2021-01-13T08:56:35.795-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:56:35.805-08:00 INFO DockerTestBase [main] Running 'cluster-init' on node n1 (192.168.176.2) with services: [DATA] 2021-01-13T08:56:35.805-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-13T08:56:36.363-08:00 INFO DockerTestBase [main+] >> SUCCESS: Cluster initialized 2021-01-13T08:56:36.376-08:00 INFO UpgradeTestBase [main] Creating n2 node using 'this build' docker image... 2021-01-13T08:56:36.377-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002n2 to /opt/couchbase/var 2021-01-13T08:56:36.377-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:56:36.454-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1433530306: Pulling from couchbase/server-toy 2021-01-13T08:56:36.456-08:00 INFO DockerTestBase [main+] >> Digest: sha256:31f304179078d22a5e4d73398a9cfdee5d01fd4d664c652ce431374a123faac1 2021-01-13T08:56:36.456-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:56:36.457-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1433530306 2021-01-13T08:56:36.460-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0002_n2_thisbuild, network = { name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410, id = 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb }) 2021-01-13T08:56:37.258-08:00 INFO DockerTestBase [main] Container information for 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed: host: n2.couchbase.host, ip: 192.168.176.3, 172.17.0.1:57133->192.168.176.3:8091, 172.17.0.1:57129->192.168.176.3:8095 2021-01-13T08:56:45.301-08:00 INFO DockerTestBase [main] Running 'node-init' on node n2 (192.168.176.3) 2021-01-13T08:56:45.301-08:00 INFO DockerTestBase [main] Executing the command: docker exec 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname n2.couchbase.host 2021-01-13T08:56:46.497-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:56:46.524-08:00 INFO UpgradeTestBase [main] Creating n3 node using 'this build' docker image... 2021-01-13T08:56:46.525-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003n3 to /opt/couchbase/var 2021-01-13T08:56:46.526-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0003_n3_thisbuild, network = { name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410, id = 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb }) 2021-01-13T08:56:47.362-08:00 INFO DockerTestBase [main] Container information for a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6: host: n3.couchbase.host, ip: 192.168.176.4, 172.17.0.1:57148->192.168.176.4:8091, 172.17.0.1:57144->192.168.176.4:8095 2021-01-13T08:56:55.401-08:00 INFO DockerTestBase [main] Running 'node-init' on node n3 (192.168.176.4) 2021-01-13T08:56:55.402-08:00 INFO DockerTestBase [main] Executing the command: docker exec a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname n3.couchbase.host 2021-01-13T08:56:56.102-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:56:56.140-08:00 INFO DockerTestBase [main] Running 'server-add' for node n2 (192.168.176.3) with services: [ANALYTICS] 2021-01-13T08:56:56.141-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:56:58.970-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:56:58.980-08:00 INFO DockerTestBase [main] Running 'server-add' for node n3 (192.168.176.4) with services: [ANALYTICS] 2021-01-13T08:56:58.980-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.2:8091 -u couchbase -p couchbase --server-add http://n3.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-13T08:57:02.058-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:57:02.065-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-13T08:57:02.066-08:00 INFO DockerTestBase [main] Executing the command: docker exec 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.2:8091 -u couchbase -p couchbase 2021-01-13T08:57:10.020-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T08:57:10.021-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T08:57:10.049-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T08:57:10.063-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T08:57:10.076-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T08:57:18.592-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57118] 2021-01-13T08:57:18.598-08:00 INFO KvStoreHttpHelper [main] installing sample(s): [beer-sample] on 172.17.0.1:57118 2021-01-13T08:57:18.687-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57133] 2021-01-13T08:57:22.834-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T08:57:22.837-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T08:57:23.698-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-13T08:57:23.704-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-13T08:57:24.706-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16BE 2021-01-13T08:57:25.120-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 536 } 2021-01-13T08:57:25.120-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 536 } 2021-01-13T08:57:26.121-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-32 2021-01-13T08:57:26.412-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 3065 } 2021-01-13T08:57:26.413-08:00 INFO DockerTestBase [main] Failed attempt number: 3. ResultSet found : { "$1": 3065 } 2021-01-13T08:57:27.611-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T08:57:27.612-08:00 INFO DockerTestBase [main] Success 2021-01-13T08:57:27.612-08:00 INFO UpgradeTestBase [main] Upgrading n1.couchbase.host (online, rebalance) ... 2021-01-13T08:57:27.612-08:00 INFO UpgradeTestBase [main] Creating n1-new node using 'this build' docker image... 2021-01-13T08:57:27.613-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004n1new to /opt/couchbase/var 2021-01-13T08:57:27.614-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0004_n1new_thisbuild, network = { name = cbas-docker-test-0001-4e51ab84-a834-4a5e-b2b2-8c5cd67ab410, id = 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb }) 2021-01-13T08:57:28.601-08:00 INFO DockerTestBase [main] Container information for 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98: host: n1new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:57163->192.168.176.5:8091, 172.17.0.1:57159->192.168.176.5:8095 2021-01-13T08:57:36.728-08:00 INFO DockerTestBase [main] Running 'node-init' on node n1new (192.168.176.5) 2021-01-13T08:57:36.729-08:00 INFO DockerTestBase [main] Executing the command: docker exec 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname n1new.couchbase.host 2021-01-13T08:57:37.456-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-13T08:57:37.500-08:00 INFO DockerTestBase [main] Running 'server-add' for node n1new (192.168.176.5) with services: [DATA] 2021-01-13T08:57:37.501-08:00 INFO DockerTestBase [main] Executing the command: docker exec 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://n1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-13T08:57:40.967-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-13T08:57:41.009-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-13T08:57:41.009-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-13T08:57:41.011-08:00 INFO DockerTestBase [main] Executing the command: docker exec 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove n1.couchbase.host 2021-01-13T09:02:58.991-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-13T09:02:58.991-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-13T09:02:59.088-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-13T09:02:59.102-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-13T09:02:59.103-08:00 INFO DockerTestBase [main] Copying files from docker container 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0001_n1_couchbase_enterprise-5.5.2 2021-01-13T09:03:01.023-08:00 INFO DockerTestBase [main] Stopping docker container: 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a 2021-01-13T09:03:01.454-08:00 INFO DockerTestBase [main] Stopped docker container: 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a 2021-01-13T09:03:01.455-08:00 INFO DockerTestBase [main] Removing docker container: 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a 2021-01-13T09:03:01.470-08:00 INFO DockerTestBase [main] Removed docker container: 5af81eb67db0f436a1ec03657d498b067e97b90c6bd9948c0e1b3b6bcdb7c60a 2021-01-13T09:03:01.477-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-13T09:03:01.492-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e36294e[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@6b34aa4c] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:02.505-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@343c52a4[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@3afbab8b] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:03.522-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51d614a9[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@5f11e13b] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:04.534-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68eb2db5[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@2de9a66c] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:05.546-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58c6f10b[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@560115bb] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:06.560-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45214f98[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@4be6a894] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:07.573-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78d77d47[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@76108df5] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:08.583-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dae455c[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@4369a341] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:09.595-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.lang.Exception: HTTP error 400: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b08f790[Not completed, task = com.couchbase.analytics.servlet.NodeDiagnosticsServlet$$Lambda$560/0x000000010094a440@55cf0359] rejected from org.apache.hyracks.util.MaintainedThreadNameExecutorService@6eb206c2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 82] 2021-01-13T09:03:10.599-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T09:03:11.603-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:12.607-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:13.611-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:14.614-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T09:03:15.618-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:16.622-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T09:03:17.626-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:18.631-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:19.635-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:20.639-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-13T09:03:21.643-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:22.647-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-13T09:03:24.504-08:00 INFO DockerTestBase [main] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T09:03:24.505-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-13T09:03:27.190-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57148] 2021-01-13T09:03:27.190-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-13T09:03:27.191-08:00 INFO TestExecutor [main] using Accept-Charset: UTF-16LE 2021-01-13T09:03:27.193-08:00 INFO KvStoreHttpHelper [ForkJoinPool.commonPool-worker-3] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:57133] 2021-01-13T09:03:27.193-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for all beers to be ingested... 2021-01-13T09:03:27.193-08:00 INFO TestExecutor [ForkJoinPool.commonPool-worker-3] using Accept-Charset: UTF-16BE 2021-01-13T09:03:28.188-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] ResultSet found : { "$1": 5891 } 2021-01-13T09:03:28.188-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Success 2021-01-13T09:03:28.217-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-13T09:03:28.218-08:00 INFO DockerTestBase [main] Success 2021-01-13T09:03:28.220-08:00 INFO DockerTestBase [main] Copying files from docker container a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0003_n3_thisbuild 2021-01-13T09:03:28.224-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0004_n1new_thisbuild 2021-01-13T09:03:28.227-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD/upgrade55ToCheckoutOnline/0002_n2_thisbuild 2021-01-13T09:03:28.769-08:00 INFO DockerTestBase [main] Stopping docker container: a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6 2021-01-13T09:03:32.417-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed 2021-01-13T09:03:32.783-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98 2021-01-13T09:03:34.040-08:00 INFO DockerTestBase [main] Stopped docker container: a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6 2021-01-13T09:03:34.074-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed 2021-01-13T09:03:34.374-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98 2021-01-13T09:03:34.375-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed 2021-01-13T09:03:34.375-08:00 INFO DockerTestBase [main] Removing docker container: a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6 2021-01-13T09:03:34.376-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removing docker container: 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98 2021-01-13T09:03:34.386-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 513e13a00093178b18569b8e65a9e9dd4be36fbcd42dc0fdd76b7191cac713ed 2021-01-13T09:03:34.387-08:00 INFO DockerTestBase [main] Removed docker container: a1b8fb714d0840987ba8b21daf21222a2d59c20c2d0ea8493bc57bc196d466a6 2021-01-13T09:03:34.392-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Removed docker container: 855bc4fad95e9a0b33ba8031bc0c7072a5ba5322b646e5f18ff895b406a58d98 2021-01-13T09:03:34.393-08:00 INFO DockerTestBase [main] Removing docker network: 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb 2021-01-13T09:03:34.448-08:00 INFO DockerTestBase [main] Removed docker network: 5d4fcce2aa347161d788a1a5897827fd578c7309519e1a745af48b832f86dedb 2021-01-13T09:03:34.457-08:00 WARN TestMethodTracer [main] ### upgrade55ToCheckoutOnline SUCCEEDED [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 434.101 s - in com.couchbase.analytics.test.docker.upgrade.vulcan.UpgradeFrom55ITD [INFO] [INFO] Results: [INFO] [ERROR] Failures: [ERROR] IpAddressRefreshITD.refreshCcIpAddress:37->UpgradeTestBase.verifyCbasAllBeers:121->UpgradeTestBase.lambda$verifyCbasAllBeers$2:123->UpgradeTestBase.waitForAllBeers:106->ClusterTestBase.waitForAllBeers:1208->ClusterTestBase.pollQuery:1171->ClusterTestBase.pollQuery:1192 Expected result to be { "$1": 5891 } but last result acquired = { "$1": 3911 } [ERROR] Errors: [ERROR] CbRemoteLinks660CEITD>ClusterTestBase.lambda$invokeAll$32:1130->CbRemoteLinksDockerTestBase.lambda$runRemoteLinkTest$2:91->UpgradeTestBase.createNode:152->DockerTestBase.createAndStartContainer:394->DockerTestBase.createAndStartContainer:400->DockerTestBase.createAndStartContainer:407->DockerTestBase.createAndStartContainer:415->DockerTestBase.createAndStartContainer:518 ยป IO [INFO] [ERROR] Tests run: 92, Failures: 1, Errors: 1, Skipped: 5 [INFO] [JENKINS] Recording test results [INFO] [INFO] --- maven-failsafe-plugin:2.21.0:verify (default) @ cbas-docker-test --- [ERROR] There are test failures. Please refer to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/failsafe-reports for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. [JENKINS] Recording test results [JENKINS] Archiving disabled