Started by remote host 172.23.107.166 [EnvInject] - Loading node environment variables. Building remotely on slv-s22501 (P0 jython_slave PY3P0) in workspace /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability [WS-CLEANUP] Deleting project workspace... Running Prebuild steps [centosnonroot-p0-os_certify-vset00-00-durability] $ /bin/sh -xe /tmp/jenkins5039391154236860248.sh ++ echo os_certify-durability-Feb-16-00:50:20-7.0.0-4454 ++ awk '{split($0,r,"-");print r[1],r[2]}' + desc='os_certify durability' + echo Desc: 7.0.0-4454 - os_certify durability - centosnonroot Desc: 7.0.0-4454 - os_certify durability - centosnonroot + echo newState=available + newState=available Success build forhudson.tasks.Shell@53cc02f6 [description-setter] Description set: 7.0.0-4454 - os_certify durability - centosnonroot Success build forhudson.plugins.descriptionsetter.DescriptionSetterBuilder@41f2737b [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'propfile' [EnvInject] - Variables injected successfully. Success build fororg.jenkinsci.plugins.envinject.EnvInjectBuilder@de1b538 Cloning the remote Git repository Using shallow clone Cloning repository git://github.com/couchbaselabs/TAF.git > /usr/bin/git init /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability # timeout=10 Fetching upstream changes from git://github.com/couchbaselabs/TAF.git > /usr/bin/git --version # timeout=10 > /usr/bin/git fetch --tags --progress git://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* --depth=1 # timeout=30 > /usr/bin/git config remote.origin.url git://github.com/couchbaselabs/TAF.git # timeout=10 > /usr/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url git://github.com/couchbaselabs/TAF.git # timeout=10 Fetching upstream changes from git://github.com/couchbaselabs/TAF.git > /usr/bin/git fetch --tags --progress git://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* --depth=1 # timeout=30 > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 Checking out Revision d9866fb97cd2d576a3ce42a93277f4b8dd84e1df (origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 > /usr/bin/git checkout -f d9866fb97cd2d576a3ce42a93277f4b8dd84e1df > /usr/bin/git rev-list 748728502a34595f9b2d033c3329933ac19eb71d # timeout=10 First time build. Skipping changelog. > /usr/bin/git tag -a -f -m Jenkins Build #92510 jenkins-test_suite_executor-TAF-92510 # timeout=10 No emails were triggered. [centosnonroot-p0-os_certify-vset00-00-durability] $ /bin/sh -xe /tmp/jenkins6511511987434917843.sh + echo Desc: os_certify-durability-Feb-16-00:50:20-7.0.0-4454 Desc: os_certify-durability-Feb-16-00:50:20-7.0.0-4454 [description-setter] Could not determine description. [centosnonroot-p0-os_certify-vset00-00-durability] $ /bin/bash /tmp/jenkins8946457258105408419.sh ############################################## Installing dependencies from requirements.txt ############################################## Requirement already satisfied (use --upgrade to upgrade): futures==3.3.0 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 1)) Requirement already satisfied (use --upgrade to upgrade): requests==2.24.0 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 2)) Requirement already satisfied (use --upgrade to upgrade): urllib3==1.25.10 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 3)) Requirement already satisfied (use --upgrade to upgrade): ruamel.yaml==0.16.12 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 4)) Cleaning up... #################### Done #################### [centosnonroot-p0-os_certify-vset00-00-durability] $ /bin/bash /tmp/jenkins2536062115538305583.sh Cloning into 'guides'... Starting a Gradle Daemon, 8 busy Daemons could not be reused, use --status for details > Configure project : Using Transaction_client :: 1.1.0 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/ssh.py 7.0.0-4454 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/eagles_all_around.py 7.0.0-4454 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main scripts/install.py 7.0.0-4454 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources testrunner.py 7.0.0-4454 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py 7.0.0-4454 --executor_jenkins_job --manual_run > Task :compileJava Note: /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/src/main/java/com/couchbase/test/transactions/SimpleTransaction.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :rerun_job Feb 16, 2021 12:50:57 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.core][CoreCreatedEvent] {"clientVersion":"3.0.7","clientGitHash":"06d706c3","coreVersion":"2.0.8","coreGitHash":"06d706c3","userAgent":"couchbase-java/3.0.7 (Linux 3.10.0-1127.13.1.el7.x86_64 amd64; OpenJDK 64-Bit Server VM 1.8.0_252-b09)","maxNumRequestsInRetry":32768,"ioEnvironment":{"nativeIoEnabled":true,"eventLoopThreadCount":4,"eventLoopGroups":["EpollEventLoopGroup"]},"ioConfig":{"captureTraffic":[],"mutationTokensEnabled":true,"networkResolution":"auto","dnsSrvEnabled":true,"tcpKeepAlivesEnabled":true,"tcpKeepAliveTimeMs":60000,"configPollIntervalMs":2500,"kvCircuitBreakerConfig":"disabled","queryCircuitBreakerConfig":"disabled","viewCircuitBreakerConfig":"disabled","searchCircuitBreakerConfig":"disabled","analyticsCircuitBreakerConfig":"disabled","managerCircuitBreakerConfig":"disabled","numKvConnections":1,"maxHttpConnections":12,"idleHttpConnectionTimeoutMs":4500,"configIdleRedialTimeoutMs":300000},"compressionConfig":{"enabled":true,"minRatio":0.83,"minSize":32},"securityConfig":{"tlsEnabled":false,"nativeTlsEnabled":true,"hasTrustCertificates":false,"trustManagerFactory":null},"timeoutConfig":{"kvMs":2500,"kvDurableMs":10000,"managementMs":75000,"queryMs":75000,"viewMs":75000,"searchMs":75000,"analyticsMs":75000,"connectMs":10000,"disconnectMs":10000},"loggerConfig":{"customLogger":null,"fallbackToConsole":false,"disableSlf4j":false,"loggerName":"CouchbaseLogger","diagnosticContextEnabled":false},"orphanReporterConfig":{"emitIntervalMs":10000,"sampleSize":10,"queueLength":1024},"thresholdRequestTracerConfig":{"emitIntervalMs":10000,"sampleSize":10,"queueLength":1024,"kvThresholdMs":500,"queryThresholdMs":1000,"searchThresholdMs":1000,"analyticsThresholdMs":1000,"viewThresholdMs":1000},"retryStrategy":"BestEffortRetryStrategy","requestTracer":"ThresholdRequestTracer"} {"coreId":"0x8d5bf5cd00000001","seedNodes":[{"address":"172.23.121.84"}]} Feb 16, 2021 12:50:57 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0x8d5bf5cd00000001","managerPort":"8091","remote":"172.23.121.84"} Feb 16, 2021 12:50:58 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0x8d5bf5cd00000001","managerPort":"8091","remote":"172.23.104.153"} Feb 16, 2021 12:50:58 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0x8d5bf5cd00000001","managerPort":"8091","remote":"172.23.98.63"} Feb 16, 2021 12:50:58 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0x8d5bf5cd00000001","managerPort":"8091","remote":"172.23.109.245"} Feb 16, 2021 12:50:58 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0x8d5bf5cd00000001","managerPort":"8091","remote":"172.23.99.54"} Feb 16, 2021 12:50:58 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.core][BucketOpenedEvent][489ms] Opened bucket "rerun_jobs" {"coreId":"0x8d5bf5cd00000001"} reading from centosnonroot_os_certify_durability_7.0.0-4454 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 27s 2 actionable tasks: 2 executed [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'rerun_props_file' [EnvInject] - Variables injected successfully. [centosnonroot-p0-os_certify-vset00-00-durability] $ /bin/bash /tmp/jenkins2241899169735528830.sh core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 95612 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 202400 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 202400 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 7.0.0-4454 Set ALLOW_HTP to False so test could run. the major release is 7 "172.23.104.158","172.23.104.172","172.23.105.126","172.23.105.127","172.23.105.128","172.23.105.158" Searching for httplib2 Best match: httplib2 0.9.2 Processing httplib2-0.9.2-py2.7.egg httplib2 0.9.2 is already the active version in easy-install.pth Using /usr/lib/python2.7/site-packages/httplib2-0.9.2-py2.7.egg Processing dependencies for httplib2 Finished processing dependencies for httplib2 Requirement already satisfied (use --upgrade to upgrade): requests in /opt/jython/Lib/site-packages Cleaning up... Requirement already satisfied (use --upgrade to upgrade): futures in /opt/jython/Lib/site-packages Cleaning up... Cloning into 'testrunner'... [global] username:root password:couchbase [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:dynamic port:8091 services:kv,index,n1ql [_2] ip:dynamic port:8091 services:kv,index,n1ql [_3] ip:dynamic port:8091 [_4] ip:dynamic port:8091 [_5] ip:dynamic port:8091 [_6] ip:dynamic port:8091 python3 scripts/populateIni.py -s "172.23.104.158","172.23.104.172","172.23.105.126","172.23.105.127","172.23.105.128","172.23.105.158" -d None -a None -i /tmp/testexec_reformat.14313.ini -p centosnonroot -o /tmp/testexec.14313.ini -k {"username":"nonroot","password":"couchbase"} INFO:root:SSH Connecting to 172.23.105.126 with username:root, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.105.127 with username:root, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.105.158 with username:root, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.104.172 with username:root, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.104.158 with username:root, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.105.128 with username:root, attempt#1 of 5 INFO:root:SSH Connected to 172.23.105.128 as root INFO:root:SSH Connected to 172.23.105.126 as root INFO:root:SSH Connected to 172.23.105.127 as root INFO:root:SSH Connected to 172.23.105.158 as root INFO:root:SSH Connected to 172.23.104.172 as root INFO:root:SSH Connected to 172.23.104.158 as root INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:os_distro: CentOS, os_version: centos 7, is_linux_distro: True INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.105.127: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.105.158: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.105.126: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.105.128: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with root INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.104.172: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with root INFO:root:command executed successfully with root INFO:root:command executed successfully with root INFO:root:command executed successfully with root INFO:root:extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 INFO:root:running command.raw on 172.23.104.158: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with root in main the ini file is /tmp/testexec_reformat.14313.ini the given server info is "172.23.104.158","172.23.104.172","172.23.105.126","172.23.105.127","172.23.105.128","172.23.105.158" Collecting memory info from 172.23.105.127 Collecting memory info from 172.23.105.158 Collecting memory info from 172.23.105.126 Collecting memory info from 172.23.105.128 Collecting memory info from 172.23.104.172 Collecting memory info from 172.23.104.158 the servers memory info is [('172.23.104.172', 3854856), ('172.23.105.127', 4103152), ('172.23.105.126', 4103152), ('172.23.105.128', 4103152), ('172.23.105.158', 4103156), ('172.23.104.158', 4103200)] [global] username:nonroot password:couchbase [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:172.23.104.172 port:8091 services:kv,index,n1ql [_2] ip:172.23.105.127 port:8091 services:kv,index,n1ql [_3] ip:172.23.105.126 port:8091 [_4] ip:172.23.105.128 port:8091 [_5] ip:172.23.105.158 port:8091 [_6] ip:172.23.104.158 port:8091 extra install is ,timeout=1200,skip_local_download=True > Configure project : Using Transaction_client :: 1.1.0 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/ssh.py -i /tmp/testexec_root.14313.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/eagles_all_around.py -i /tmp/testexec_root.14313.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main scripts/install.py -i /tmp/testexec_root.14313.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/testexec_root.14313.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/testexec_root.14313.ini iptables -F > Task :iptables 172.23.105.126 172.23.105.128 172.23.105.127 172.23.105.158 172.23.104.172 172.23.104.158 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 11s 1 actionable task: 1 executed Already on 'master' From https://github.com/couchbase/testrunner * branch master -> FETCH_HEAD Already up-to-date. 7.0.0-4454 2021-02-16 00:51:52,374 - root - WARNING - URL: is not valid, will use version to locate build 2021-02-16 00:51:52,376 - root - INFO - SSH Connecting to 172.23.104.172 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:52,521 - root - INFO - SSH Connected to 172.23.104.172 as nonroot 2021-02-16 00:51:52,815 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:53,217 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:53,221 - root - INFO - SSH Connecting to 172.23.105.127 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:53,324 - root - INFO - SSH Connected to 172.23.105.127 as nonroot 2021-02-16 00:51:53,604 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:53,936 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:53,939 - root - INFO - SSH Connecting to 172.23.105.126 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:54,047 - root - INFO - SSH Connected to 172.23.105.126 as nonroot 2021-02-16 00:51:54,355 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:54,691 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:54,694 - root - INFO - SSH Connecting to 172.23.105.128 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:54,795 - root - INFO - SSH Connected to 172.23.105.128 as nonroot 2021-02-16 00:51:55,092 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:55,419 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:55,423 - root - INFO - SSH Connecting to 172.23.105.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:55,526 - root - INFO - SSH Connected to 172.23.105.158 as nonroot 2021-02-16 00:51:55,813 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:56,147 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:56,150 - root - INFO - SSH Connecting to 172.23.104.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:56,337 - root - INFO - SSH Connected to 172.23.104.158 as nonroot 2021-02-16 00:51:56,869 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:57,349 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:57,352 - root - INFO - SSH Connecting to 172.23.104.172 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:57,506 - root - INFO - SSH Connected to 172.23.104.172 as nonroot 2021-02-16 00:51:57,823 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:58,251 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:58,254 - root - INFO - SSH Connecting to 172.23.105.127 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:58,355 - root - INFO - SSH Connected to 172.23.105.127 as nonroot 2021-02-16 00:51:58,627 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:58,954 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:58,958 - root - INFO - SSH Connecting to 172.23.105.126 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:59,064 - root - INFO - SSH Connected to 172.23.105.126 as nonroot 2021-02-16 00:51:59,369 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:51:59,701 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:51:59,704 - root - INFO - SSH Connecting to 172.23.105.128 with username:nonroot, attempt#1 of 5 2021-02-16 00:51:59,806 - root - INFO - SSH Connected to 172.23.105.128 as nonroot 2021-02-16 00:52:00,091 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:00,425 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:00,428 - root - INFO - SSH Connecting to 172.23.105.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:00,530 - root - INFO - SSH Connected to 172.23.105.158 as nonroot 2021-02-16 00:52:00,822 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:01,165 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:01,169 - root - INFO - SSH Connecting to 172.23.104.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:01,353 - root - INFO - SSH Connected to 172.23.104.158 as nonroot 2021-02-16 00:52:01,906 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:02,393 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:02,395 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,399 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,399 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,401 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,401 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,402 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,403 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,404 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,404 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,406 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,406 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:02,407 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm is live 2021-02-16 00:52:02,408 - root - INFO - Downloading build binary to 172.23.104.172:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:07,659 - root - INFO - running command.raw on 172.23.104.172: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:07,698 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:07,698 - root - INFO - running command.raw on 172.23.104.172: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:07,769 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:07,841 - root - INFO - Downloading build binary to 172.23.105.127:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:08,870 - root - INFO - running command.raw on 172.23.105.127: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:08,896 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:08,896 - root - INFO - running command.raw on 172.23.105.127: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:08,953 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:09,012 - root - INFO - Downloading build binary to 172.23.105.126:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:10,259 - root - INFO - running command.raw on 172.23.105.126: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:10,323 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:10,323 - root - INFO - running command.raw on 172.23.105.126: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:10,381 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:10,441 - root - INFO - Downloading build binary to 172.23.105.128:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:11,654 - root - INFO - running command.raw on 172.23.105.128: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:11,678 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:11,678 - root - INFO - running command.raw on 172.23.105.128: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:11,736 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:11,795 - root - INFO - Downloading build binary to 172.23.105.158:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:12,962 - root - INFO - running command.raw on 172.23.105.158: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:13,027 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:13,028 - root - INFO - running command.raw on 172.23.105.158: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:13,086 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:13,145 - root - INFO - Downloading build binary to 172.23.104.158:/home/nonroot/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm.. 2021-02-16 00:52:18,332 - root - INFO - running command.raw on 172.23.104.158: curl -I http://172.23.126.166/builds/latestbuilds/couchbase-server/cheshire-cat/4454/couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2>&1 | grep Content-Length 2021-02-16 00:52:18,377 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:18,377 - root - INFO - running command.raw on 172.23.104.158: cd /home/nonroot/ && wc -c couchbase-server-enterprise-7.0.0-4454-centos7.x86_64.rpm 2021-02-16 00:52:18,449 - root - INFO - command executed successfully with nonroot 2021-02-16 00:52:18,532 - root - INFO - SSH Connecting to 172.23.104.172 with username:root, attempt#1 of 5 2021-02-16 00:52:18,535 - root - INFO - SSH Connecting to 172.23.105.127 with username:root, attempt#1 of 5 2021-02-16 00:52:18,539 - root - INFO - SSH Connecting to 172.23.105.128 with username:root, attempt#1 of 5 2021-02-16 00:52:18,542 - root - INFO - SSH Connecting to 172.23.105.158 with username:root, attempt#1 of 5 2021-02-16 00:52:18,544 - root - INFO - SSH Connecting to 172.23.105.126 with username:root, attempt#1 of 5 2021-02-16 00:52:18,548 - root - INFO - SSH Connecting to 172.23.104.158 with username:root, attempt#1 of 5 2021-02-16 00:52:18,642 - root - INFO - SSH Connected to 172.23.105.127 as root 2021-02-16 00:52:18,648 - root - INFO - SSH Connected to 172.23.105.158 as root 2021-02-16 00:52:18,653 - root - INFO - SSH Connected to 172.23.105.126 as root 2021-02-16 00:52:18,654 - root - INFO - SSH Connected to 172.23.105.128 as root 2021-02-16 00:52:18,691 - root - INFO - SSH Connected to 172.23.104.172 as root 2021-02-16 00:52:18,731 - root - INFO - SSH Connected to 172.23.104.158 as root 2021-02-16 00:52:18,905 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:18,947 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:18,955 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:18,965 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:19,011 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:19,268 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:19,270 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:19,284 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:19,295 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:19,321 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:19,400 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:19,710 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:20,983 - root - INFO - SSH Connecting to 172.23.105.128 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:21,086 - root - INFO - SSH Connected to 172.23.105.128 as nonroot 2021-02-16 00:52:21,377 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:21,718 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:21,719 - root - INFO - Done with uninstall on 172.23.105.128. 2021-02-16 00:52:22,333 - root - INFO - SSH Connecting to 172.23.105.127 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:22,389 - root - INFO - SSH Connecting to 172.23.105.126 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:22,437 - root - INFO - SSH Connecting to 172.23.105.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:22,439 - root - INFO - SSH Connected to 172.23.105.127 as nonroot 2021-02-16 00:52:22,492 - root - INFO - SSH Connected to 172.23.105.126 as nonroot 2021-02-16 00:52:22,539 - root - INFO - SSH Connected to 172.23.105.158 as nonroot 2021-02-16 00:52:22,718 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:22,804 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:22,840 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:23,049 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:23,050 - root - INFO - Done with uninstall on 172.23.105.127. 2021-02-16 00:52:23,139 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:23,140 - root - INFO - Done with uninstall on 172.23.105.126. 2021-02-16 00:52:23,184 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:23,186 - root - INFO - Done with uninstall on 172.23.105.158. 2021-02-16 00:52:24,044 - root - INFO - SSH Connecting to 172.23.104.172 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:24,203 - root - INFO - SSH Connected to 172.23.104.172 as nonroot 2021-02-16 00:52:24,512 - root - INFO - SSH Connecting to 172.23.104.158 with username:nonroot, attempt#1 of 5 2021-02-16 00:52:24,540 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:24,699 - root - INFO - SSH Connected to 172.23.104.158 as nonroot 2021-02-16 00:52:24,964 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:24,965 - root - INFO - Done with uninstall on 172.23.104.172. 2021-02-16 00:52:25,283 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-02-16 00:52:25,770 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-02-16 00:52:25,771 - root - INFO - Done with uninstall on 172.23.104.158. 2021-02-16 00:56:01,878 - root - INFO - Done with install on 172.23.104.172. 2021-02-16 00:56:04,099 - root - INFO - Done with install on 172.23.104.158. 2021-02-16 00:56:13,929 - root - INFO - Done with install on 172.23.105.128. 2021-02-16 00:56:15,187 - root - INFO - Done with install on 172.23.105.127. 2021-02-16 00:56:15,664 - root - INFO - Done with install on 172.23.105.126. 2021-02-16 00:56:15,736 - root - INFO - Done with install on 172.23.105.158. 2021-02-16 00:57:01,938 - root - INFO - running command.raw on 172.23.104.172: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.104.172 -u Administrator -p password 2021-02-16 00:57:02,529 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:03,550 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.104.172 2021-02-16 00:57:03,550 - root - INFO - pools/default params : indexMemoryQuota=256 2021-02-16 00:57:03,563 - root - INFO - Setting KV memory quota as 1761 MB on 172.23.104.172 2021-02-16 00:57:03,563 - root - INFO - pools/default params : memoryQuota=1761 2021-02-16 00:57:03,572 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'index', 'n1ql']) 2021-02-16 00:57:03,572 - root - INFO - /node/controller/setupServices params on 172.23.104.172: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cindex%2Cn1ql 2021-02-16 00:57:03,609 - root - INFO - settings/indexes params : storageMode=plasma 2021-02-16 00:57:03,621 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:03,621 - root - INFO - settings/web params on 172.23.104.172:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:03,792 - root - INFO - --> status:True 2021-02-16 00:57:03,793 - root - INFO - Done with init on 172.23.104.172. 2021-02-16 00:57:03,831 - root - INFO - Done with cleanup on 172.23.104.172. 2021-02-16 00:57:04,156 - root - INFO - running command.raw on 172.23.104.158: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.104.158 -u Administrator -p password 2021-02-16 00:57:04,943 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:05,969 - root - INFO - Setting KV memory quota as 2147 MB on 172.23.104.158 2021-02-16 00:57:05,969 - root - INFO - pools/default params : memoryQuota=2147 2021-02-16 00:57:05,990 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2021-02-16 00:57:05,990 - root - INFO - /node/controller/setupServices params on 172.23.104.158: 8091:hostname=None&user=Administrator&password=password&services=kv 2021-02-16 00:57:06,034 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:06,034 - root - INFO - settings/web params on 172.23.104.158:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:06,191 - root - INFO - --> status:True 2021-02-16 00:57:06,191 - root - INFO - Done with init on 172.23.104.158. 2021-02-16 00:57:06,235 - root - INFO - Done with cleanup on 172.23.104.158. 2021-02-16 00:57:13,988 - root - INFO - running command.raw on 172.23.105.128: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.128 -u Administrator -p password 2021-02-16 00:57:14,243 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:15,218 - root - INFO - running command.raw on 172.23.105.127: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.127 -u Administrator -p password 2021-02-16 00:57:15,255 - root - INFO - Setting KV memory quota as 2147 MB on 172.23.105.128 2021-02-16 00:57:15,256 - root - INFO - pools/default params : memoryQuota=2147 2021-02-16 00:57:15,263 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2021-02-16 00:57:15,264 - root - INFO - /node/controller/setupServices params on 172.23.105.128: 8091:hostname=None&user=Administrator&password=password&services=kv 2021-02-16 00:57:15,293 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:15,293 - root - INFO - settings/web params on 172.23.105.128:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:15,353 - root - INFO - --> status:True 2021-02-16 00:57:15,353 - root - INFO - Done with init on 172.23.105.128. 2021-02-16 00:57:15,379 - root - INFO - Done with cleanup on 172.23.105.128. 2021-02-16 00:57:15,475 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:15,669 - root - INFO - running command.raw on 172.23.105.126: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.126 -u Administrator -p password 2021-02-16 00:57:15,753 - root - INFO - running command.raw on 172.23.105.158: /home/nonroot/opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.158 -u Administrator -p password 2021-02-16 00:57:15,943 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:16,023 - root - INFO - command executed successfully with nonroot 2021-02-16 00:57:16,489 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.127 2021-02-16 00:57:16,489 - root - INFO - pools/default params : indexMemoryQuota=256 2021-02-16 00:57:16,497 - root - INFO - Setting KV memory quota as 1891 MB on 172.23.105.127 2021-02-16 00:57:16,497 - root - INFO - pools/default params : memoryQuota=1891 2021-02-16 00:57:16,501 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'index', 'n1ql']) 2021-02-16 00:57:16,501 - root - INFO - /node/controller/setupServices params on 172.23.105.127: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cindex%2Cn1ql 2021-02-16 00:57:16,530 - root - INFO - settings/indexes params : storageMode=plasma 2021-02-16 00:57:16,536 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:16,536 - root - INFO - settings/web params on 172.23.105.127:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:16,600 - root - INFO - --> status:True 2021-02-16 00:57:16,601 - root - INFO - Done with init on 172.23.105.127. 2021-02-16 00:57:16,626 - root - INFO - Done with cleanup on 172.23.105.127. 2021-02-16 00:57:16,955 - root - INFO - Setting KV memory quota as 2147 MB on 172.23.105.126 2021-02-16 00:57:16,955 - root - INFO - pools/default params : memoryQuota=2147 2021-02-16 00:57:16,963 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2021-02-16 00:57:16,963 - root - INFO - /node/controller/setupServices params on 172.23.105.126: 8091:hostname=None&user=Administrator&password=password&services=kv 2021-02-16 00:57:16,993 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:16,994 - root - INFO - settings/web params on 172.23.105.126:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:17,035 - root - INFO - Setting KV memory quota as 2147 MB on 172.23.105.158 2021-02-16 00:57:17,035 - root - INFO - pools/default params : memoryQuota=2147 2021-02-16 00:57:17,043 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2021-02-16 00:57:17,043 - root - INFO - /node/controller/setupServices params on 172.23.105.158: 8091:hostname=None&user=Administrator&password=password&services=kv 2021-02-16 00:57:17,059 - root - INFO - --> status:True 2021-02-16 00:57:17,059 - root - INFO - Done with init on 172.23.105.126. 2021-02-16 00:57:17,073 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-02-16 00:57:17,074 - root - INFO - settings/web params on 172.23.105.158:8091:port=8091&username=Administrator&password=password 2021-02-16 00:57:17,082 - root - INFO - Done with cleanup on 172.23.105.126. 2021-02-16 00:57:17,134 - root - INFO - --> status:True 2021-02-16 00:57:17,134 - root - INFO - Done with init on 172.23.105.158. 2021-02-16 00:57:17,155 - root - INFO - Done with cleanup on 172.23.105.158. 2021-02-16 00:57:18,755 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-02-16 00:57:18,775 - root - INFO - node:172.23.104.172:8091 version:7.0.0-4454-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-02-16 00:57:18,780 - root - INFO - node:172.23.105.127:8091 version:7.0.0-4454-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-02-16 00:57:18,785 - root - INFO - node:172.23.105.126:8091 version:7.0.0-4454-enterprise aFamily:inet services:['kv'] 2021-02-16 00:57:18,790 - root - INFO - node:172.23.105.128:8091 version:7.0.0-4454-enterprise aFamily:inet services:['kv'] 2021-02-16 00:57:18,795 - root - INFO - node:172.23.105.158:8091 version:7.0.0-4454-enterprise aFamily:inet services:['kv'] 2021-02-16 00:57:18,814 - root - INFO - node:172.23.104.158:8091 version:7.0.0-4454-enterprise aFamily:inet services:['kv'] 2021-02-16 00:57:18,814 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-02-16 00:57:18,814 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-02-16 00:57:18,815 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.104.172 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.105.127 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.105.126 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.105.128 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.105.158 2021-02-16 00:57:18,815 - root - INFO - INSTALL COMPLETED ON: 172.23.104.158 2021-02-16 00:57:18,816 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-02-16 00:57:18,816 - root - INFO - TOTAL INSTALL TIME = 326 seconds Need to set ALLOW_HTP back to True to do git pull branch Switched to a new branch 'master' Branch master set up to track remote branch master from origin. From git://github.com/couchbaselabs/TAF * branch master -> FETCH_HEAD Updating d9866fb..aee85c9 Fast-forward lib/membase/api/rest_client.py | 9 +++++++++ pytests/bucket_collections/collections_rebalance.py | 21 +++++++++++++++++++++ pytests/magma/magma_expiry_compaction.py | 2 ++ 3 files changed, 32 insertions(+) Set ALLOW_HTP to False so test could run. From git://github.com/couchbaselabs/TAF d9866fb..aee85c9 master -> origin/master HEAD is now at aee85c9 CBQE-6464: Set ephemeral bucket's purge age and interval find: ‘/data/workspace/centos-p0-transaction-vset00-00-autofailover_durability_majority_and_persist_on_master_6.5_P0_Set1/logs/testrunner-21-Jan-15_16-13-51/test_1’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_67’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_68’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_25’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_44’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_19’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_63’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_77’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_75’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_56’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_36’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_49’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_41’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_65’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_26’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_35’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_12’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_47’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_34’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_10’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_27’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_6’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_32’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_17’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_28’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_48’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_58’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_40’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_66’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_3’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_50’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_61’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_8’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_37’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_15’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_78’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_43’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_9’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_39’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_53’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_51’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_20’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_55’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_69’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_4’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_60’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_74’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_71’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_16’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_76’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_46’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_33’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_73’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_54’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_23’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_14’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_2’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_42’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_21’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_72’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_13’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_30’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_45’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_57’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_29’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_62’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_38’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_5’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_70’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_7’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_11’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_64’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_22’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_24’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_52’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_59’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_18’: No such file or directory find: ‘/data/workspace/windows-p0-os_certify-vset00-00-n1ql/logs/testrunner-21-Jan-16_00-15-53/test_31’: No such file or directory find: ‘/root/workspace/*/logs/*’: No such file or directory find: ‘/root/workspace/’: No such file or directory python: no process found jython: no process found -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ Timeout: 90 minutes > Configure project : Using Transaction_client :: 1.1.4 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/ssh.py -i /tmp/testexec.14313.ini -c conf/sanity/durability.conf -p sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -m rest -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/eagles_all_around.py -i /tmp/testexec.14313.ini -c conf/sanity/durability.conf -p sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -m rest -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main scripts/install.py -i /tmp/testexec.14313.ini -c conf/sanity/durability.conf -p sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -m rest -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/testexec.14313.ini -c conf/sanity/durability.conf -p sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -m rest -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/testexec.14313.ini -c conf/sanity/durability.conf -p sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -m rest -d failed=http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197/ > Task :compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :testrunner Filename: conf/sanity/durability.conf Prefix: epengine.basic_ops.basic_ops Prefix: epengine.durability_success.DurabilitySuccessTests Prefix: subdoc.sub_doc_success.BasicOps Prefix: rebalance_new.rebalance_in.RebalanceInTests Prefix: rebalance_new.rebalance_out.RebalanceOutTests Prefix: rebalance_new.swaprebalancetests.SwapRebalanceStartStopTests Prefix: rebalance_new.swaprebalancetests.SwapRebalanceBasicTests Prefix: failover.failovertests.FailoverTests Downloading http://qa.sc.couchbase.com/job/test_suite_executor-TAF/91197//testReport/api/xml?pretty=true to logs/test_suite_executor-TAF_91197__testresult.xml Loading result data from logs/test_suite_executor-TAF_91197__testresult.xml -- logs/test_suite_executor-TAF_91197__testresult.xml -- Global Test input params: {'cluster_name': 'testexec.14313', 'conf_file': 'conf/sanity/durability.conf', 'ini': '/tmp/testexec.14313.ini', 'num_nodes': 6, 'rerun': 'False', 'sdk_timeout': '60', 'spec': 'durability', 'upgrade_version': '7.0.0-4454'} Logs will be stored at /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/logs/testrunner-21-Feb-16_00-57-40/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.14313.ini sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 -t rebalance_new.rebalance_in.RebalanceInTests.incremental_rebalance_in_with_ops,get-cbcollect-info=False,replicas=1,durability=PERSIST_TO_MAJORITY,upgrade_version=7.0.0-4454,nodes_in=1,rerun=False,nodes_init=2,num_items=10000,sdk_timeout=60' Test Input params: {'cluster_name': 'testexec.14313', u'get-cbcollect-info': u'False', 'ini': '/tmp/testexec.14313.ini', u'replicas': u'1', u'durability': u'PERSIST_TO_MAJORITY', 'conf_file': 'conf/sanity/durability.conf', u'upgrade_version': '7.0.0-4454', u'nodes_in': u'1', u'rerun': 'False', 'spec': 'durability', 'num_nodes': 6, 'logs_folder': '/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/logs/testrunner-21-Feb-16_00-57-40/test_1', u'nodes_init': u'2', u'num_items': u'10000', u'sdk_timeout': '60', 'case_number': 1} incremental_rebalance_in_with_ops (rebalance_new.rebalance_in.RebalanceInTests) ... 2021-02-16 00:57:49,549 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= RebalanceInTests setup started for test #1 incremental_rebalance_in_with_ops ========= 2021-02-16 00:57:50,348 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup started for test #1 incremental_rebalance_in_with_ops ========= 2021-02-16 00:57:52,042 | test | INFO | MainThread | [basetestcase:setUp:318] Initializing cluster Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Traceback (most recent call last): File "/opt/jython/Lib/logging/__init__.py", line 853, in emit msg = self.format(record) File "/opt/jython/Lib/logging/__init__.py", line 726, in format return fmt.format(record) File "/opt/jython/Lib/logging/__init__.py", line 469, in format s = self._fmt % record.__dict__ UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 18: ordinal not in range(128) Logged from file remote_util.py, line 3061 Got this failure java.net.ConnectException: Connection refused: /172.23.104.158:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x3dc06c6e, 0.0.0.0/0.0.0.0:39570] timeout=120.0>) 2021-02-16 00:58:32,522 | test | ERROR | pool-1-thread-6 | [rest_client:_http_request:751] Socket error while connecting to http://172.23.104.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.104.158:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x493c3502, 0.0.0.0/0.0.0.0:36456] timeout=120.0>) 2021-02-16 00:58:34,555 | test | ERROR | pool-1-thread-6 | [rest_client:_http_request:751] Socket error while connecting to http://172.23.104.158:8091/nodes/self error [Errno 111] Connection refused 2021-02-16 00:58:36,900 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:587] RAM quota was defined less than 100 MB: 2021-02-16 00:58:54,073 | test | INFO | MainThread | [basetestcase:setUp:340] Couchbase Cluster: C1, Nodes: 172.23.104.172, 172.23.105.127, 172.23.105.126, 172.23.105.128, 172.23.105.158, 172.23.104.158 initialized 2021-02-16 00:58:54,098 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup finished for test #1 incremental_rebalance_in_with_ops ========= 2021-02-16 00:58:59,392 | test | INFO | pool-1-thread-7 | [table_view:display:72] Rebalance Overview +----------------+-----------------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+-----------------+-----------------------+---------------+--------------+ | 172.23.104.172 | index, kv, n1ql | 7.0.0-4454-enterprise | 4.81958112541 | Cluster node | | 172.23.105.127 | None | | | <--- IN --- | +----------------+-----------------+-----------------------+---------------+--------------+ 2021-02-16 00:58:59,414 | test | INFO | pool-1-thread-7 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-16 00:59:09,496 | test | INFO | pool-1-thread-7 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-16 00:59:09,523 | test | INFO | pool-1-thread-7 | [task:check:389] Rebalance completed with progress: 100% in 10.1319999695 sec 2021-02-16 00:59:32,913 | test | INFO | MainThread | [rebalance_base:setUp:137] Verifying num_items counts after doc_ops 2021-02-16 00:59:36,805 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4388] Validating collection stats and item counts 2021-02-16 00:59:44,513 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+------------+------------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+------------+------------+---------------------+-------------------+-----------------------+ | 172.23.104.172 | index, kv, n1ql | 30.4111714507 | 3947372544 | 3168100352 | 221184 / 3758092288 | 5000 / 5000 | 7.0.0-4454-enterprise | | 172.23.105.127 | kv | 15.5005107252 | 4201627648 | 3476430848 | 0 / 3758092288 | 5000 / 5000 | 7.0.0-4454-enterprise | +----------------+-----------------+-----------------+------------+------------+---------------------+-------------------+-----------------------+ 2021-02-16 00:59:44,611 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +---------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | default | couchbase | 1 | none | 0 | 10000 | 2805989376 | 74719552 | 43833562 | +---------+-----------+----------+------------+-----+-------+------------+----------+-----------+ 2021-02-16 00:59:44,612 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= RebalanceBase setup complete for test #1 incremental_rebalance_in_with_ops ========= 2021-02-16 00:59:44,698 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: wait for rebalance to start 2021-02-16 00:59:50,726 | test | INFO | pool-1-thread-1 | [table_view:display:72] Rebalance Overview +----------------+-----------------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+-----------------+-----------------------+---------------+--------------+ | 172.23.104.172 | index, kv, n1ql | 7.0.0-4454-enterprise | 30.4111714507 | Cluster node | | 172.23.105.127 | kv | 7.0.0-4454-enterprise | 15.5005107252 | Cluster node | | 172.23.105.126 | None | | | <--- IN --- | | 172.23.105.128 | None | | | <--- IN --- | +----------------+-----------------+-----------------------+---------------+--------------+ 2021-02-16 00:59:50,750 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-16 00:59:55,878 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 10.2080720457 2021-02-16 01:00:00,969 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 28.4494321349 2021-02-16 01:00:05,233 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13761 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:05,236 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13761 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:05,982 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12534 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:05,983 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12534 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:06,098 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 40.4426430114 2021-02-16 01:00:06,466 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12546 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:06,467 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12546 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:06,822 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-18848 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:06,823 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-18848 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:07,217 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10010 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:07,220 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10010 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:08,937 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13898 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-13908 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:08,938 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13898 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-13908 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:09,730 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17627 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:09,733 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17627 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:09,776 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13930 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-13940 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:09,778 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-13930 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-13940 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:10,055 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11323 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:10,056 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11323 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:11,194 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 51.4322916667 2021-02-16 01:00:11,572 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17705 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:11,573 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17705 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,375 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12784 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,375 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12784 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,431 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17740 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,434 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17740 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,836 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11435 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:12,838 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11435 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,042 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17766 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,043 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17766 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,548 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16526 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,551 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16526 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,707 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12828 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:13,709 | test | INFO | pool-1-thread-22 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-12828 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,532 | test | INFO | pool-1-thread-12 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-15315 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,535 | test | INFO | pool-1-thread-12 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-15315 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,676 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-19138 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,677 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-19138 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,805 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17830 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:14,808 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17830 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:15,895 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16603 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:15,898 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16603 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:16,151 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17875 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:16,154 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-17875 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:16,575 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 62.6736474011 2021-02-16 01:00:17,601 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16689 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:17,601 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16689 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:18,561 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-14283 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:18,562 | test | INFO | pool-1-thread-30 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-14283 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:20,835 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16796 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:20,838 | test | INFO | pool-1-thread-28 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-16796 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:21,647 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-19395 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:21,648 | test | INFO | pool-1-thread-13 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-19395 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:21,654 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10529 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:21,655 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10529 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:21,766 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 69.81028341 2021-02-16 01:00:22,733 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10560 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:22,734 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10560 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:22,822 | test | INFO | pool-1-thread-12 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-15629 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:22,822 | test | INFO | pool-1-thread-12 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-15629 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:26,928 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 80.0445930881 2021-02-16 01:00:28,035 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11854 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:28,036 | test | INFO | pool-1-thread-23 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-11854 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:29,701 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10680 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:29,704 | test | INFO | pool-1-thread-8 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-10680 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:30,400 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-18273 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:30,401 | test | INFO | pool-1-thread-18 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-18273 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:00:37,063 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-16 01:00:37,105 | test | INFO | pool-1-thread-1 | [task:check:389] Rebalance completed with progress: 100% in 46.3789999485 sec 2021-02-16 01:00:37,717 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 4 docs from 10000 to 11250 2021-02-16 01:00:37,773 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 3 docs from 11250 to 12500 2021-02-16 01:00:37,773 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 4 docs from 12500 to 13750 2021-02-16 01:00:37,775 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 6 docs from 13750 to 15000 2021-02-16 01:00:37,775 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 2 docs from 15000 to 16250 2021-02-16 01:00:37,776 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 4 docs from 16250 to 17500 2021-02-16 01:00:37,776 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 7 docs from 17500 to 18750 2021-02-16 01:00:37,776 | test | ERROR | pool-1-thread-6 | [task:call:1610] Failed to load 3 docs from 18750 to 20000 2021-02-16 01:00:37,871 | test | INFO | pool-1-thread-7 | [table_view:display:72] Ops trend for bucket 'default' +---------+-----------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-----------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................*.................***...............................................***X | 310.649 | | 181.371 | .........................................................*X | 181.371 | +---------+-----------------------------------------------------------------------------------------------------------------+---------+ 2021-02-16 01:00:39,809 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Wait for cluster to be ready after rebalance 2021-02-16 01:01:39,890 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: wait for rebalance to start 2021-02-16 01:01:52,529 | test | INFO | pool-1-thread-27 | [table_view:display:72] Rebalance Overview +----------------+-----------------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+-----------------+-----------------------+---------------+--------------+ | 172.23.105.126 | kv | 7.0.0-4454-enterprise | 1.55700652938 | Cluster node | | 172.23.105.128 | kv | 7.0.0-4454-enterprise | 1.45801910508 | Cluster node | | 172.23.104.172 | index, kv, n1ql | 7.0.0-4454-enterprise | 4.43436633913 | Cluster node | | 172.23.105.127 | kv | 7.0.0-4454-enterprise | 1.35746606335 | Cluster node | | 172.23.105.158 | None | | | <--- IN --- | | 172.23.104.158 | None | | | <--- IN --- | +----------------+-----------------+-----------------------+---------------+--------------+ 2021-02-16 01:01:52,551 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-16 01:01:57,654 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 8.80732262683 2021-02-16 01:02:02,789 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 33.5701851811 2021-02-16 01:02:03,779 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27517 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:03,780 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27517 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:04,453 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23771 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:04,456 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23771 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:04,512 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27549 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:04,513 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27549 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,450 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26322 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,451 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26322 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,743 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20094 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,744 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20094 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,799 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23828 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:05,802 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23828 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:06,040 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26337 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:06,042 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26337 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:06,500 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27594 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:06,502 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27594 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:07,838 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27600 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:07,838 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27600 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:07,924 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 55.2145139361 2021-02-16 01:02:08,318 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20178 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:08,319 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20178 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:08,782 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21445 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:08,782 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21445 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,279 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23982 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-23983 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,280 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22728 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,282 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-23982 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-23983 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,282 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22728 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,539 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26482 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:09,542 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26482 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,479 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26512 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,480 | test | INFO | pool-1-thread-26 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-26512 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,599 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24031 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,601 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24031 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,858 | test | INFO | pool-1-thread-20 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-25184 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:10,861 | test | INFO | pool-1-thread-20 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-25184 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,029 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20339 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,030 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20339 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,476 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20346 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,479 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20346 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,528 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22849 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,529 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22849 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,782 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24092 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-24102 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,783 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24092 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-24102 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,829 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27805 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,832 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-27805 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,904 | test | INFO | pool-1-thread-15 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-29105 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-29095 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,904 | test | INFO | pool-1-thread-15 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-29105 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-29095 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,937 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22884 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:11,938 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22884 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,049 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20409 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,052 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20409 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,088 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21499 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | | test_docs-21509 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,088 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21499 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | | test_docs-21509 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,207 | test | INFO | pool-1-thread-15 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-29111 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,207 | test | INFO | pool-1-thread-15 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-29111 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,240 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24146 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,242 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24146 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,252 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22914 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,253 | test | INFO | pool-1-thread-14 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-22914 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,571 | test | INFO | pool-1-thread-20 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-25320 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:12,572 | test | INFO | pool-1-thread-20 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-25320 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:13,109 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.1828583993 2021-02-16 01:02:14,578 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20529 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:14,579 | test | INFO | pool-1-thread-17 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-20529 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:14,766 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21613 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:14,767 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21613 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:14,960 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24235 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:14,963 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24235 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:15,533 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21633 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:15,535 | test | INFO | pool-1-thread-25 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-21633 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:16,680 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24329 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:16,681 | test | INFO | pool-1-thread-24 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-24329 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:16,898 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-28052 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:16,901 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-28052 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:18,243 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 88.5438069649 2021-02-16 01:02:18,733 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | Read Key | Exception | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-28116 | {'error': 'com.couchbase.client.core.error.DocumentNotFoundException | Document with the given id not found', 'cas': 0, 'value': {}} | +-----------------+--------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:18,734 | test | INFO | pool-1-thread-16 | [table_view:display:72] Keys failed in default:_default:_default +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Create Key | Exception | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ | test_docs-28116 | com.couchbase.client.core.error.DurabilityImpossibleException | With the current cluster configuration, the requested durability guarantees are impossible | +-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2021-02-16 01:02:22,519 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 6 docs from 20000 to 21250 2021-02-16 01:02:23,013 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 5 docs from 21250 to 22500 2021-02-16 01:02:23,015 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 4 docs from 22500 to 23750 2021-02-16 01:02:23,015 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 10 docs from 23750 to 25000 2021-02-16 01:02:23,016 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 2 docs from 25000 to 26250 2021-02-16 01:02:23,016 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 4 docs from 26250 to 27500 2021-02-16 01:02:23,017 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 7 docs from 27500 to 28750 2021-02-16 01:02:23,017 | test | ERROR | pool-1-thread-29 | [task:call:1610] Failed to load 3 docs from 28750 to 30000 2021-02-16 01:02:23,081 | test | INFO | pool-1-thread-11 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................*................................**X | 235.876 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2021-02-16 01:02:28,411 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-16 01:02:28,459 | test | INFO | pool-1-thread-27 | [task:check:389] Rebalance completed with progress: 100% in 35.9319999218 sec 2021-02-16 01:02:31,069 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Wait for cluster to be ready after rebalance 2021-02-16 01:03:36,551 | test | CRITICAL | MainThread | [bucket_ready_functions:verify_unacked_bytes_all_buckets:2802] Bucket default has unacked bytes != 0: 1 2021-02-16 01:04:01,638 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+------------+------------+----------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+------------+------------+----------------------+-------------------+-----------------------+ | 172.23.105.126 | kv | 6.43701282374 | 4201627648 | 3425701888 | 1048576 / 3758092288 | 4989 / 5108 | 7.0.0-4454-enterprise | | 172.23.105.128 | kv | 6.16507297433 | 4201627648 | 3424706560 | 0 / 3758092288 | 5127 / 4934 | 7.0.0-4454-enterprise | | 172.23.104.172 | index, kv, n1ql | 11.7691723614 | 3947372544 | 3012943872 | 221184 / 3758092288 | 4982 / 5103 | 7.0.0-4454-enterprise | | 172.23.105.127 | kv | 4.88664987406 | 4201627648 | 3397816320 | 0 / 3758092288 | 5075 / 5043 | 7.0.0-4454-enterprise | | 172.23.105.158 | kv | 5.79199194158 | 4201631744 | 3393880064 | 0 / 3758092288 | 4936 / 4884 | 7.0.0-4454-enterprise | | 172.23.104.158 | kv | 14.847715736 | 4201676800 | 3443019776 | 1310720 / 3758092288 | 4891 / 4928 | 7.0.0-4454-enterprise | +----------------+-----------------+-----------------+------------+------------+----------------------+-------------------+-----------------------+ 2021-02-16 01:04:11,607 | test | ERROR | MainThread | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-16 01:04:11,651 | test | INFO | MainThread | [rest_client:print_UI_logs:2589] Latest logs from UI on 172.23.104.172: 2021-02-16 01:04:11,651 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.172', u'tstamp': 1613466250322L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:10.322Z', u'text': u"Node 'ns_1@172.23.104.172' saw that node 'ns_1@172.23.105.158' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,653 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.158', u'tstamp': 1613466250322L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:10.322Z', u'text': u"Node 'ns_1@172.23.104.158' saw that node 'ns_1@172.23.105.158' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,654 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.104.172', u'tstamp': 1613466250318L, u'shortText': u'message', u'serverTime': u'2021-02-16T01:04:10.318Z', u'text': u'Rebalance exited with reason shun_failed.\nRebalance Operation Id = 9ebe83ad7194372a38613770f88d57a1'} 2021-02-16 01:04:11,654 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 1, u'module': u'ns_cluster', u'type': u'info', u'node': u'ns_1@172.23.105.158', u'tstamp': 1613466250131L, u'shortText': u'message', u'serverTime': u'2021-02-16T01:04:10.131Z', u'text': u"Node 'ns_1@172.23.105.158' is leaving cluster."} 2021-02-16 01:04:11,654 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.172', u'tstamp': 1613466249851L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:09.851Z', u'text': u"Node 'ns_1@172.23.104.172' saw that node 'ns_1@172.23.105.127' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,655 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.158', u'tstamp': 1613466249850L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:09.850Z', u'text': u"Node 'ns_1@172.23.104.158' saw that node 'ns_1@172.23.105.127' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,655 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.105.158', u'tstamp': 1613466249849L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:09.849Z', u'text': u"Node 'ns_1@172.23.105.158' saw that node 'ns_1@172.23.105.127' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,657 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 1, u'module': u'ns_cluster', u'type': u'info', u'node': u'ns_1@172.23.105.127', u'tstamp': 1613466249657L, u'shortText': u'message', u'serverTime': u'2021-02-16T01:04:09.657Z', u'text': u"Node 'ns_1@172.23.105.127' is leaving cluster."} 2021-02-16 01:04:11,657 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.172', u'tstamp': 1613466249629L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:09.629Z', u'text': u"Node 'ns_1@172.23.104.172' saw that node 'ns_1@172.23.105.128' went down. Details: [{nodedown_reason,\n connection_closed}]"} 2021-02-16 01:04:11,657 | test | ERROR | MainThread | [rest_client:print_UI_logs:2591] {u'code': 5, u'module': u'ns_node_disco', u'type': u'warning', u'node': u'ns_1@172.23.104.158', u'tstamp': 1613466249625L, u'shortText': u'node down', u'serverTime': u'2021-02-16T01:04:09.625Z', u'text': u"Node 'ns_1@172.23.104.158' saw that node 'ns_1@172.23.105.128' went down. Details: [{nodedown_reason,\n connection_closed}]"} Traceback (most recent call last): File "pytests/basetestcase.py", line 494, in tearDownEverything cluster_util.cluster_cleanup(bucket_util) File "couchbase_utils/cluster_utils/cluster_ready_functions.py", line 131, in cluster_cleanup self.cleanup_cluster(self.cluster.servers, master=self.cluster.master) File "couchbase_utils/cluster_utils/cluster_ready_functions.py", line 171, in cleanup_cluster ejectedNodes=[node.id for node in nodes File "lib/membase/api/rest_client.py", line 130, in remove_nodes return self.rest.monitorRebalance() File "lib/membase/api/rest_client.py", line 1418, in monitorRebalance progress = self._rebalance_progress() File "lib/membase/api/rest_client.py", line 1527, in _rebalance_progress return self._rebalance_status_and_progress()[1] File "lib/membase/api/rest_client.py", line 1496, in _rebalance_status_and_progress raise RebalanceFailedException(msg) RebalanceFailedException: Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-16 01:04:11,661 | test | WARNING | MainThread | [basetestcase:tearDownEverything:498] Killing memcached due to Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed ok ---------------------------------------------------------------------- Ran 1 test in 391.348s OK During the test, Remote Connections: 91, Disconnections: 85 SDK Connections: 39, Disconnections: 39 !!!!!! CRITICAL :: Shell disconnection mismatch !!!!! summary so far suite rebalance_new.rebalance_in.RebalanceInTests , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/logs/testrunner-21-Feb-16_00-57-40/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 6m 47s 2 actionable tasks: 2 executed workspace is /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability fails is 0 1 Desc1: 7.0.0-4454 - os_certify durability - centosnonroot (1/1) > Configure project : Using Transaction_client :: 1.1.4 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/ssh.py 7.0.0-4454 --executor_jenkins_job --run_params=sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/eagles_all_around.py 7.0.0-4454 --executor_jenkins_job --run_params=sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main scripts/install.py 7.0.0-4454 --executor_jenkins_job --run_params=sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources testrunner.py 7.0.0-4454 --executor_jenkins_job --run_params=sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 Running: /opt/jython/bin/jython -J-cp /data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/classes/java/main:/data/workspace/centosnonroot-p0-os_certify-vset00-00-durability/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.4/bb27634a406d547ec910999434a483048000d266/couchbase-transactions-1.1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.0/8c3109610eaf4755494582c88cc8c38333ae0c0f/java-client-3.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.0/6a41cffed1e58bdd16c554fff1a58cd52e075c0e/core-io-2.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.0/683c9c676c438e5945b0f12808575f22160c5e54/reactor-core-3.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py 7.0.0-4454 --executor_jenkins_job --run_params=sdk_timeout=60,rerun=False,upgrade_version=7.0.0-4454 > Task :compileJava UP-TO-DATE > Task :rerun_job Feb 16, 2021 1:04:23 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.core][CoreCreatedEvent] {"clientVersion":"3.1.0","clientGitHash":"9d504d25","coreVersion":"2.1.0","coreGitHash":"9d504d25","userAgent":"couchbase-java/3.1.0 (Linux 3.10.0-1127.13.1.el7.x86_64 amd64; OpenJDK 64-Bit Server VM 1.8.0_252-b09)","maxNumRequestsInRetry":32768,"ioEnvironment":{"nativeIoEnabled":true,"eventLoopThreadCount":4,"eventLoopGroups":["EpollEventLoopGroup"]},"ioConfig":{"captureTraffic":[],"mutationTokensEnabled":true,"networkResolution":"auto","dnsSrvEnabled":true,"tcpKeepAlivesEnabled":true,"tcpKeepAliveTimeMs":60000,"configPollIntervalMs":2500,"kvCircuitBreakerConfig":"disabled","queryCircuitBreakerConfig":"disabled","viewCircuitBreakerConfig":"disabled","searchCircuitBreakerConfig":"disabled","analyticsCircuitBreakerConfig":"disabled","managerCircuitBreakerConfig":"disabled","numKvConnections":1,"maxHttpConnections":12,"idleHttpConnectionTimeoutMs":4500,"configIdleRedialTimeoutMs":300000},"compressionConfig":{"enabled":true,"minRatio":0.83,"minSize":32},"securityConfig":{"tlsEnabled":false,"nativeTlsEnabled":true,"hostnameVerificationEnabled":true,"hasTrustCertificates":false,"trustManagerFactory":null},"timeoutConfig":{"kvMs":2500,"kvDurableMs":10000,"managementMs":75000,"queryMs":75000,"viewMs":75000,"searchMs":75000,"analyticsMs":75000,"connectMs":10000,"disconnectMs":10000},"loggerConfig":{"customLogger":null,"fallbackToConsole":false,"disableSlf4j":false,"loggerName":"CouchbaseLogger","diagnosticContextEnabled":false},"orphanReporterConfig":{"emitIntervalMs":10000,"sampleSize":10,"queueLength":1024},"thresholdRequestTracerConfig":{"emitIntervalMs":10000,"sampleSize":10,"queueLength":1024,"kvThresholdMs":500,"queryThresholdMs":1000,"searchThresholdMs":1000,"analyticsThresholdMs":1000,"viewThresholdMs":1000},"aggregatingMeterConfig":{"enabled":false,"emitIntervalMs":600000},"retryStrategy":"BestEffortRetryStrategy","requestTracer":"ThresholdRequestTracer","meter":"NoopMeter"} {"coreId":"0xd4c23a9900000001","seedNodes":[{"address":"172.23.121.84"}]} Feb 16, 2021 1:04:23 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0xd4c23a9900000001","managerPort":"8091","remote":"172.23.121.84"} Feb 16, 2021 1:04:24 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0xd4c23a9900000001","managerPort":"8091","remote":"172.23.104.153"} Feb 16, 2021 1:04:24 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0xd4c23a9900000001","managerPort":"8091","remote":"172.23.98.63"} Feb 16, 2021 1:04:24 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0xd4c23a9900000001","managerPort":"8091","remote":"172.23.109.245"} Feb 16, 2021 1:04:24 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.node][NodeConnectedEvent] Node connected {"coreId":"0xd4c23a9900000001","managerPort":"8091","remote":"172.23.99.54"} Feb 16, 2021 1:04:24 AM com.couchbase.client.core.cnc.LoggingEventConsumer$JdkLogger info INFO: [com.couchbase.core][BucketOpenedEvent][509ms] Opened bucket "rerun_jobs" {"coreId":"0xd4c23a9900000001"} Build was aborted Aborted by Ashwin G Archiving artifacts Recording test results [BFA] Scanning build for known causes... [BFA] No failure causes found [BFA] Done. 0s Notifying upstream projects of job completion No emails were triggered. Triggering a new build of savejoblogs Triggering a new build of test-executor-cleanup Triggering a new build of test-executor-cleanup-dynvm Finished: ABORTED