[INFO] Running com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD 2021-01-27 20:04:50,549 main INFO Registered Log4j as the java.util.logging.LogManager. 2021-01-27T20:04:50.647-08:00 INFO ClusterTestBase [main] configured sslWorkDir to /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/sslWork 2021-01-27T20:04:50.666-08:00 INFO DockerTestBase [main] resolved dockerHostAddr using 'host.docker.internal': 172.17.0.1 2021-01-27T20:04:50.666-08:00 INFO DockerTestBase [main] Docker image id=build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1445710109 dockerHostAddr=172.17.0.1 dockerContainerId=15bbf6ace9541fba673d668caff53185c3153600b02f872921186420c2e25aab 2021-01-27T20:04:50.823-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics START 2021-01-27T20:04:51.955-08:00 INFO DockerTestBase [main] Creating docker network (name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33) 2021-01-27T20:04:52.032-08:00 INFO DockerTestBase [main] Created docker network: { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 } 2021-01-27T20:04:52.081-08:00 INFO UpgradeTestBase [pool] Creating cbas1 node ([couchbase:enterprise-6.0.0])... 2021-01-27T20:04:52.081-08:00 INFO UpgradeTestBase [pool] Creating kv1 node ([couchbase:enterprise-6.0.0])... 2021-01-27T20:04:52.083-08:00 INFO UpgradeTestBase [pool] Creating cbas2 node ([couchbase:enterprise-6.0.0])... 2021-01-27T20:04:52.085-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0001cbas1 to /opt/couchbase/var 2021-01-27T20:04:52.085-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0002cbas2 to /opt/couchbase/var 2021-01-27T20:04:52.090-08:00 INFO DockerTestBase [pool] Executing the command: docker pull couchbase:enterprise-6.0.0 2021-01-27T20:04:52.087-08:00 INFO UpgradeTestBase [pool] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0003kv1 to /opt/couchbase/var 2021-01-27T20:04:53.665-08:00 INFO DockerTestBase [pool+] >> enterprise-6.0.0: Pulling from library/couchbase 2021-01-27T20:04:54.047-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Pulling fs layer 2021-01-27T20:04:54.047-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Pulling fs layer 2021-01-27T20:04:54.048-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Pulling fs layer 2021-01-27T20:04:54.048-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Pulling fs layer 2021-01-27T20:04:54.048-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Pulling fs layer 2021-01-27T20:04:54.048-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Pulling fs layer 2021-01-27T20:04:54.049-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Pulling fs layer 2021-01-27T20:04:54.049-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Pulling fs layer 2021-01-27T20:04:54.049-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Pulling fs layer 2021-01-27T20:04:54.049-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Waiting 2021-01-27T20:04:54.050-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Waiting 2021-01-27T20:04:54.050-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Waiting 2021-01-27T20:04:54.050-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Waiting 2021-01-27T20:04:54.050-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Waiting 2021-01-27T20:04:54.050-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Waiting 2021-01-27T20:04:54.051-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Pulling fs layer 2021-01-27T20:04:54.051-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Pulling fs layer 2021-01-27T20:04:54.051-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Pulling fs layer 2021-01-27T20:04:54.051-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Pulling fs layer 2021-01-27T20:04:54.051-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Waiting 2021-01-27T20:04:54.052-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Waiting 2021-01-27T20:04:54.052-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Waiting 2021-01-27T20:04:54.052-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Waiting 2021-01-27T20:04:54.437-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Verifying Checksum 2021-01-27T20:04:54.438-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Download complete 2021-01-27T20:04:54.444-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Verifying Checksum 2021-01-27T20:04:54.444-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Download complete 2021-01-27T20:04:54.800-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Verifying Checksum 2021-01-27T20:04:54.801-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Download complete 2021-01-27T20:04:55.150-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Verifying Checksum 2021-01-27T20:04:55.151-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Download complete 2021-01-27T20:04:55.620-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Verifying Checksum 2021-01-27T20:04:55.620-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Download complete 2021-01-27T20:04:55.742-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Verifying Checksum 2021-01-27T20:04:55.743-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Download complete 2021-01-27T20:04:55.962-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Verifying Checksum 2021-01-27T20:04:55.962-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Download complete 2021-01-27T20:04:56.092-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Verifying Checksum 2021-01-27T20:04:56.093-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Download complete 2021-01-27T20:04:56.449-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Verifying Checksum 2021-01-27T20:04:56.450-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Download complete 2021-01-27T20:04:56.516-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Verifying Checksum 2021-01-27T20:04:56.516-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Download complete 2021-01-27T20:04:56.819-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Verifying Checksum 2021-01-27T20:04:56.819-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Download complete 2021-01-27T20:04:56.856-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Verifying Checksum 2021-01-27T20:04:56.856-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Download complete 2021-01-27T20:04:58.121-08:00 INFO DockerTestBase [pool+] >> 7b722c1070cd: Pull complete 2021-01-27T20:04:58.245-08:00 INFO DockerTestBase [pool+] >> 5fbf74db61f1: Pull complete 2021-01-27T20:04:58.400-08:00 INFO DockerTestBase [pool+] >> ed41cb72e5c9: Pull complete 2021-01-27T20:04:58.520-08:00 INFO DockerTestBase [pool+] >> 7ea47a67709e: Pull complete 2021-01-27T20:04:59.877-08:00 INFO DockerTestBase [pool+] >> ca04de705515: Pull complete 2021-01-27T20:05:00.009-08:00 INFO DockerTestBase [pool+] >> ce20af7f0ef5: Pull complete 2021-01-27T20:05:03.200-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Verifying Checksum 2021-01-27T20:05:03.201-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Download complete 2021-01-27T20:05:11.535-08:00 INFO DockerTestBase [pool+] >> 397a78ce7d99: Pull complete 2021-01-27T20:05:11.653-08:00 INFO DockerTestBase [pool+] >> 05a9f0b5672f: Pull complete 2021-01-27T20:05:11.768-08:00 INFO DockerTestBase [pool+] >> 4c755e368998: Pull complete 2021-01-27T20:05:11.896-08:00 INFO DockerTestBase [pool+] >> da66694ebab8: Pull complete 2021-01-27T20:05:12.008-08:00 INFO DockerTestBase [pool+] >> 378756cb2ddd: Pull complete 2021-01-27T20:05:12.124-08:00 INFO DockerTestBase [pool+] >> 819c17bd23b2: Pull complete 2021-01-27T20:05:12.232-08:00 INFO DockerTestBase [pool+] >> 3c1b06acba80: Pull complete 2021-01-27T20:05:12.242-08:00 INFO DockerTestBase [pool+] >> Digest: sha256:342fb755176fb28c826b705721d69eb0fbba8631fd41f3a103806c235bbc6760 2021-01-27T20:05:12.243-08:00 INFO DockerTestBase [pool+] >> Status: Downloaded newer image for couchbase:enterprise-6.0.0 2021-01-27T20:05:12.244-08:00 INFO DockerTestBase [pool+] >> docker.io/library/couchbase:enterprise-6.0.0 2021-01-27T20:05:12.248-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0001_cbas2_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:05:12.248-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0003_kv1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:05:12.248-08:00 INFO DockerTestBase [pool] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0002_cbas1_couchbase_enterprise-6.0.0, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:05:13.643-08:00 INFO DockerTestBase [pool] Container information for b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73: host: cbas2.couchbase.host, ip: 192.168.176.2, 172.17.0.1:50103->192.168.176.2:8095, 172.17.0.1:50111->192.168.176.2:8091 2021-01-27T20:05:13.648-08:00 INFO DockerTestBase [pool] Container information for 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58: host: cbas1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:50110->192.168.176.3:8095, 172.17.0.1:50115->192.168.176.3:8091 2021-01-27T20:05:14.345-08:00 INFO DockerTestBase [pool] Container information for 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e: host: kv1.couchbase.host, ip: 192.168.176.4, 172.17.0.1:50126->192.168.176.4:8095, 172.17.0.1:50130->192.168.176.4:8091 2021-01-27T20:05:25.807-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas1 (192.168.176.3) 2021-01-27T20:05:25.809-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.3:8091 -u couchbase -p couchbase --node-init-hostname cbas1.couchbase.host 2021-01-27T20:05:25.844-08:00 INFO DockerTestBase [pool] Running 'node-init' on node cbas2 (192.168.176.2) 2021-01-27T20:05:25.845-08:00 INFO DockerTestBase [pool] Executing the command: docker exec b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.2:8091 -u couchbase -p couchbase --node-init-hostname cbas2.couchbase.host 2021-01-27T20:05:26.293-08:00 INFO DockerTestBase [pool] Running 'node-init' on node kv1 (192.168.176.4) 2021-01-27T20:05:26.293-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.4:8091 -u couchbase -p couchbase --node-init-hostname kv1.couchbase.host 2021-01-27T20:05:26.917-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-27T20:05:26.921-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-27T20:05:27.176-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Node initialized 2021-01-27T20:05:27.188-08:00 INFO DockerTestBase [pool] Running 'cluster-init' on node kv1 (192.168.176.4) with services: [DATA] 2021-01-27T20:05:27.189-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli cluster-init -c 127.0.0.1:8091 --cluster-username couchbase --cluster-password couchbase --cluster-ramsize 512 --cluster-analytics-ramsize 1024 --services data 2021-01-27T20:05:27.604-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Cluster initialized 2021-01-27T20:05:27.623-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas1 (192.168.176.3) with services: [ANALYTICS] 2021-01-27T20:05:27.623-08:00 INFO DockerTestBase [pool] Running 'server-add' for node cbas2 (192.168.176.2) with services: [ANALYTICS] 2021-01-27T20:05:27.624-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://cbas2.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-27T20:05:27.624-08:00 INFO DockerTestBase [pool] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.4:8091 -u couchbase -p couchbase --server-add http://cbas1.couchbase.host --server-add-username couchbase --server-add-password couchbase --services analytics 2021-01-27T20:05:31.530-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-27T20:05:35.236-08:00 INFO DockerTestBase [pool+] >> SUCCESS: Server added 2021-01-27T20:05:35.244-08:00 INFO UpgradeTestBase [main] Running 'rebalance' 2021-01-27T20:05:35.245-08:00 INFO DockerTestBase [main] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.4:8091 -u couchbase -p couchbase 2021-01-27T20:05:36.606-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-27T20:05:36.606-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-27T20:05:36.630-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-27T20:05:36.639-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-27T20:05:36.648-08:00 INFO DockerTestBase [pool] Waiting for NCs == 2 & Cluster state in {ACTIVE} for up to 120s... 2021-01-27T20:05:36.692-08:00 INFO KvStoreHttpHelper [pool] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:50115] 2021-01-27T20:05:36.703-08:00 INFO KvStoreHttpHelper [pool] installing sample(s): [beer-sample] on 172.17.0.1:50115 2021-01-27T20:05:44.992-08:00 INFO KvStoreHttpHelper [main] Initializing KvStoreHttpHelper with nodes [/172.17.0.1:50115] 2021-01-27T20:05:47.882-08:00 INFO DockerTestBase [main] Waiting for all beers to be ingested... 2021-01-27T20:05:48.326-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 0 } 2021-01-27T20:05:48.336-08:00 INFO DockerTestBase [main] Failed attempt number: 1. ResultSet found : { "$1": 0 } 2021-01-27T20:05:49.586-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 2955 } 2021-01-27T20:05:49.586-08:00 INFO DockerTestBase [main] Failed attempt number: 2. ResultSet found : { "$1": 2955 } 2021-01-27T20:05:50.773-08:00 INFO DockerTestBase [main] ResultSet found : { "$1": 5891 } 2021-01-27T20:05:50.774-08:00 INFO DockerTestBase [main] Success 2021-01-27T20:05:50.774-08:00 INFO UpgradeFailoverTestBase [main] Failing over (hard) cbas nodes ... 2021-01-27T20:05:50.776-08:00 INFO DockerTestBase [main] Running 'failover --force' on [cbas1 (192.168.176.3), cbas2 (192.168.176.2)] nodes 2021-01-27T20:05:50.778-08:00 INFO DockerTestBase [main] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli failover -c 192.168.176.4:8091 -u couchbase -p couchbase --server-failover cbas1.couchbase.host,cbas2.couchbase.host --force 2021-01-27T20:05:51.170-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server failed over 2021-01-27T20:05:56.184-08:00 INFO UpgradeTestBase [main] Recreating 'cbas2' node (image = null, forceNewIp = false)... 2021-01-27T20:05:56.184-08:00 INFO UpgradeTestBase [ForkJoinPool.commonPool-worker-3] Recreating 'cbas1' node (image = null, forceNewIp = false)... 2021-01-27T20:05:56.184-08:00 INFO DockerTestBase [main] Copying files from docker container b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0001_cbas2_couchbase_enterprise-6.0.0 2021-01-27T20:05:56.185-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Copying files from docker container 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0002_cbas1_couchbase_enterprise-6.0.0 2021-01-27T20:05:56.458-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopping docker container: 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58 2021-01-27T20:05:56.461-08:00 INFO DockerTestBase [main] Stopping docker container: b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73 2021-01-27T20:05:56.969-08:00 INFO DockerTestBase [main] Stopped docker container: b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73 2021-01-27T20:05:56.969-08:00 INFO DockerTestBase [main] Removing docker container: b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73 2021-01-27T20:05:56.986-08:00 INFO DockerTestBase [main] Removed docker container: b4d7fd6ca0f5dca030abe6de236a61cf5b19a310870badf7d9b176d3707def73 2021-01-27T20:05:56.988-08:00 INFO DockerTestBase [main] Executing the command: docker pull build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1445710109 2021-01-27T20:05:57.036-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Stopped docker container: 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58 2021-01-27T20:05:57.037-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58 2021-01-27T20:05:57.049-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: 872896f6b294e663b3de12f588b811c746919bc070a6057e93b1dc7da8800f58 2021-01-27T20:05:57.073-08:00 INFO DockerTestBase [main+] >> analytics-jenkins-enterprise-7.0.0-1445710109: Pulling from couchbase/server-toy 2021-01-27T20:05:57.076-08:00 INFO DockerTestBase [main+] >> Digest: sha256:cdc9a4ba6cbaecc49300b3a797efdf0902d948543a35aec81fdd8449aa31cbd7 2021-01-27T20:05:57.076-08:00 INFO DockerTestBase [main+] >> Status: Image is up to date for build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1445710109 2021-01-27T20:05:57.077-08:00 INFO DockerTestBase [main+] >> build-docker.couchbase.com/couchbase/server-toy:analytics-jenkins-enterprise-7.0.0-1445710109 2021-01-27T20:05:57.080-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:05:57.080-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:05:58.032-08:00 INFO DockerTestBase [main] Container information for 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e: host: cbas2.couchbase.host, ip: 192.168.176.2, 172.17.0.1:50148->192.168.176.2:8095, 172.17.0.1:50156->192.168.176.2:8091 2021-01-27T20:05:58.158-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Container information for 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9: host: cbas1.couchbase.host, ip: 192.168.176.3, 172.17.0.1:50155->192.168.176.3:8095, 172.17.0.1:50160->192.168.176.3:8091 2021-01-27T20:06:06.203-08:00 INFO DockerTestBase [main] Running full 'recovery' on nodes [cbas1 (192.168.176.3), cbas2 (192.168.176.2)] 2021-01-27T20:06:06.205-08:00 INFO DockerTestBase [main] Executing the command: docker exec 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e /opt/couchbase/bin/couchbase-cli recovery -c 192.168.176.4:8091 -u couchbase -p couchbase --server-recovery cbas1.couchbase.host,cbas2.couchbase.host --recovery-type full 2021-01-27T20:06:06.518-08:00 INFO DockerTestBase [main+] >> SUCCESS: Servers recovered 2021-01-27T20:06:06.528-08:00 INFO UpgradeTestBase [main] Upgrading kv1.couchbase.host (online, rebalance) ... 2021-01-27T20:06:06.529-08:00 INFO UpgradeTestBase [main] Creating kv1-new node using 'this build' docker image... 2021-01-27T20:06:06.529-08:00 INFO UpgradeTestBase [main] binding /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/binds/0004kv1new to /opt/couchbase/var 2021-01-27T20:06:06.530-08:00 INFO DockerTestBase [main] Creating docker container (test dir = /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild, network = { name = cbas-docker-test-0001-b3afc8db-cbfa-4deb-b409-7fcc59600c33, id = fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 }) 2021-01-27T20:06:07.346-08:00 INFO DockerTestBase [main] Container information for e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606: host: kv1new.couchbase.host, ip: 192.168.176.5, 172.17.0.1:50171->192.168.176.5:8095, 172.17.0.1:50175->192.168.176.5:8091 2021-01-27T20:06:14.704-08:00 INFO DockerTestBase [main] Running 'node-init' on node kv1new (192.168.176.5) 2021-01-27T20:06:14.704-08:00 INFO DockerTestBase [main] Executing the command: docker exec e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 /opt/couchbase/bin/couchbase-cli node-init -c 192.168.176.5:8091 -u couchbase -p couchbase --node-init-hostname kv1new.couchbase.host 2021-01-27T20:06:15.456-08:00 INFO DockerTestBase [main+] >> SUCCESS: Node initialized 2021-01-27T20:06:15.509-08:00 INFO DockerTestBase [main] Running 'server-add' for node kv1new (192.168.176.5) with services: [DATA] 2021-01-27T20:06:15.509-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 /opt/couchbase/bin/couchbase-cli server-add -c 192.168.176.3:8091 -u couchbase -p couchbase --server-add http://kv1new.couchbase.host --server-add-username couchbase --server-add-password couchbase --services data 2021-01-27T20:06:18.946-08:00 INFO DockerTestBase [main+] >> SUCCESS: Server added 2021-01-27T20:06:18.979-08:00 INFO UpgradeTestBase [main] Swap rebalancing ... 2021-01-27T20:06:18.979-08:00 INFO DockerTestBase [main] Running 'rebalance-out' 2021-01-27T20:06:18.980-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 /opt/couchbase/bin/couchbase-cli rebalance -c 192.168.176.3:8091 -u couchbase -p couchbase --server-remove kv1.couchbase.host 2021-01-27T20:07:53.400-08:00 INFO DockerTestBase [main+] >> Unable to display progress bar on this os 2021-01-27T20:07:53.400-08:00 INFO DockerTestBase [main+] >> SUCCESS: Rebalance complete 2021-01-27T20:07:53.433-08:00 INFO DockerTestBase [main] Waiting for 'rebalance completion' condition for up to 120 seconds... 2021-01-27T20:07:53.443-08:00 INFO UpgradeTestBase [main] ... rebalance succeeded! 2021-01-27T20:07:53.443-08:00 INFO DockerTestBase [main] Copying files from docker container 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0003_kv1_couchbase_enterprise-6.0.0 2021-01-27T20:07:53.933-08:00 INFO DockerTestBase [main] Stopping docker container: 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e 2021-01-27T20:07:54.324-08:00 INFO DockerTestBase [main] Stopped docker container: 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e 2021-01-27T20:07:54.325-08:00 INFO DockerTestBase [main] Removing docker container: 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e 2021-01-27T20:07:54.342-08:00 INFO DockerTestBase [main] Removed docker container: 37d62d5575e0b808a6f586d8f192c90ac3a79860e1c4d8a1f5b8d3545eef191e 2021-01-27T20:07:54.351-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-27T20:07:54.351-08:00 INFO DockerTestBase [main] Waiting for 'compatibilityVersion promotion to 7.0.x' condition for up to 120 seconds... 2021-01-27T20:07:54.362-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:07:55.368-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:07:56.371-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:07:57.376-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:07:58.379-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:07:59.383-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:00.387-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:01.391-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:02.395-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:03.398-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:04.402-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:05.406-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:06.409-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:07.413-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:07.956-08:00 INFO DockerTestBase [pool] assuming 6.0 compatibility on missing 'clusterCompatibility' field 2021-01-27T20:08:08.423-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:08.961-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:09.427-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:09.965-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:10.431-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:10.970-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:11.438-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:11.974-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:12.442-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:12.978-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:13.445-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:13.982-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:14.450-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:14.986-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:15.453-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:15.991-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:16.458-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:16.995-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:17.463-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:17.999-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:18.467-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:19.003-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:19.473-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:20.006-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:20.478-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:21.011-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:21.484-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:22.015-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:22.487-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:23.019-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:23.491-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:24.024-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:24.495-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:25.028-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:25.499-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:26.032-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:26.503-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:27.036-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:27.507-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:28.040-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:28.512-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:29.044-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:29.516-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:30.047-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:30.520-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:31.051-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:31.525-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:32.054-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:32.528-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:33.058-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:33.532-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:34.062-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:34.536-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:35.067-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:35.540-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:36.071-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:36.545-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:37.075-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:37.548-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:38.079-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:38.552-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:39.083-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:39.556-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:40.087-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:40.560-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:41.092-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:41.564-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:42.096-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:42.569-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:43.100-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:43.574-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:44.106-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:44.577-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:45.111-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:45.582-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:46.116-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:46.587-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:47.120-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:47.591-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:48.124-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:48.596-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:49.128-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:49.601-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:50.132-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:50.604-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:51.136-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:51.608-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:52.140-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:52.611-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:53.144-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:53.615-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:54.147-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:54.618-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:55.151-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:55.623-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:56.154-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:56.627-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:57.157-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:57.631-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:58.161-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:58.635-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:08:59.164-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:08:59.639-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:00.169-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:00.643-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:01.173-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:01.647-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:02.177-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:02.653-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:03.182-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:03.657-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:04.187-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:04.662-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:05.191-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:05.666-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:06.195-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:06.669-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:07.201-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:07.674-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:08.205-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:08.677-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:09.209-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:09.681-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:10.213-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:10.686-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:11.217-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:11.690-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:12.221-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:12.695-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:13.226-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:13.700-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:14.230-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:14.705-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:15.235-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:15.708-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:16.238-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:16.712-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:17.241-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:17.717-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:18.245-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:18.721-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:19.248-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:19.724-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:20.252-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:20.727-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:21.255-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:21.730-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:22.259-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:22.733-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:23.280-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:23.737-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:24.283-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:24.740-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:25.287-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:25.744-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:26.291-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:26.748-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:27.295-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:27.753-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:28.300-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:28.757-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:29.304-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:29.761-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:30.307-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:30.766-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:31.312-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:31.770-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:32.315-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:32.774-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:33.320-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:33.779-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:34.324-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:34.782-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:35.327-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:35.786-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:36.330-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:36.790-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:37.334-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:37.801-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:38.337-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:38.805-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:39.340-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:39.808-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:40.344-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:40.812-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:41.346-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:41.815-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:42.350-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:42.818-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:43.353-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:43.821-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:44.357-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:44.827-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:45.360-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:45.830-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:46.364-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:46.834-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:47.367-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:47.837-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:48.371-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:48.841-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:49.375-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:49.846-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:50.378-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:50.850-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:51.382-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:51.854-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:52.385-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:52.857-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:53.388-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: org.apache.http.NoHttpResponseException: The target server failed to respond 2021-01-27T20:09:53.861-08:00 WARN DockerTestBase [pool] unable to determine cluster compatibility: java.net.SocketException: Connection reset 2021-01-27T20:09:54.353-08:00 INFO DockerTestBase [main] Timed out waiting for condition: compatibilityVersion promotion to 7.0.x 2021-01-27T20:09:54.362-08:00 INFO DockerTestBase [main] Taking cbcollect_info from cbas1 (192.168.176.3) 2021-01-27T20:09:54.362-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Taking cbcollect_info from kv1new (192.168.176.5) 2021-01-27T20:09:54.362-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Taking cbcollect_info from cbas2 (192.168.176.2) 2021-01-27T20:09:54.362-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Timed out waiting for condition: compatibilityVersion promotion to 7.0.x 2021-01-27T20:09:54.363-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-27T20:09:54.363-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Executing the command: docker exec e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-27T20:09:54.363-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Executing the command: docker exec 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e sh -c ls /opt/couchbase/var/lib/couchbase/logs/cbcollect_info*.zip 2>/dev/null | wc -l 2021-01-27T20:09:54.538-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7+] >> 0 2021-01-27T20:09:54.549-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Executing the command: docker exec e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-27T20:09:54.614-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5+] >> 0 2021-01-27T20:09:54.615-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Executing the command: docker exec 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-27T20:09:54.667-08:00 INFO DockerTestBase [main+] >> 0 2021-01-27T20:09:54.679-08:00 INFO DockerTestBase [main] Executing the command: docker exec 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 /opt/couchbase/bin/cbcollect_info /opt/couchbase/var/lib/couchbase/logs/cbcollect_info.zip 2021-01-27T20:11:44.401-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Finished taking cbcollect_info from cbas2 (192.168.176.2) 2021-01-27T20:11:44.402-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Copying files from docker container 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0004_cbas2_thisbuild 2021-01-27T20:11:45.199-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopping docker container: 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e 2021-01-27T20:11:45.828-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Stopped docker container: 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e 2021-01-27T20:12:02.063-08:00 INFO DockerTestBase [main] Finished taking cbcollect_info from cbas1 (192.168.176.3) 2021-01-27T20:12:02.064-08:00 INFO DockerTestBase [main] Copying files from docker container 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0005_cbas1_thisbuild 2021-01-27T20:12:03.241-08:00 INFO DockerTestBase [main] Stopping docker container: 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 2021-01-27T20:12:03.872-08:00 INFO DockerTestBase [main] Stopped docker container: 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 2021-01-27T20:12:19.214-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Finished taking cbcollect_info from kv1new (192.168.176.5) 2021-01-27T20:12:19.214-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Copying files from docker container e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606: /opt/couchbase/var/lib/couchbase/logs/ to local /home/couchbase/jenkins/workspace/cbas-cbcluster-docker-test/analytics/cbas/cbas-test/cbas-docker-test/target/com.couchbase.analytics.test.docker.upgrade.alice.UpgradeFromAlice600FailoverITD/failoverUpgradeAnalytics/0006_kv1new_thisbuild 2021-01-27T20:12:20.282-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopping docker container: e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 2021-01-27T20:12:20.797-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-7] Stopped docker container: e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 2021-01-27T20:12:20.799-08:00 INFO DockerTestBase [main] Removing docker container: 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e 2021-01-27T20:12:20.799-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removing docker container: 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 2021-01-27T20:12:20.800-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removing docker container: e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 2021-01-27T20:12:20.815-08:00 INFO DockerTestBase [main] Removed docker container: 4d7327e7e58128425f471375ecbb39227f8305e6f7bbfb8763f700a14f78606e 2021-01-27T20:12:20.817-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-5] Removed docker container: 4184d589430d1627a4d35cb8d40a6f3555cd6c4bec9fde84fa2b5b31aba02aa9 2021-01-27T20:12:20.825-08:00 INFO DockerTestBase [ForkJoinPool.commonPool-worker-3] Removed docker container: e24cb845cf127ea56806c6d0d62e6b2c40251dd2451b00533bd93c2ae8466606 2021-01-27T20:12:20.827-08:00 INFO DockerTestBase [main] Removing docker network: fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 2021-01-27T20:12:20.919-08:00 INFO DockerTestBase [main] Removed docker network: fd08e829ecc0ccf0b35ec51950b676ef249cf28c20806265dfe169e011c26582 2021-01-27T20:12:20.929-08:00 WARN TestMethodTracer [main] ### failoverUpgradeAnalytics FAILED